-- Logs begin at Tue 2022-10-18 23:51:34 UTC, end at Wed 2022-10-19 00:51:36 UTC. -- Oct 19 00:22:32.033494 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 19 00:22:32.040910 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 00:22:32 2022] *** Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: nodename: dv-osbrick-master-4-iscsi Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: machine: x86_64 Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: clock source: unix Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: pcre jit disabled Oct 19 00:22:32.042903 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: detected number of CPU cores: 4 Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: current working directory: / Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: detected binary path: /usr/bin/uwsgi-core Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: your processes number limit is 47680 Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: your memory page size is 4096 bytes Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: detected max file descriptor number: 2048 Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: lock engine: pthread robust mutexes Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: thunder lock: enabled Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 19 00:22:32.043421 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 00:22:32.083966 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: Python main interpreter initialized at 0x55f3c30969c0 Oct 19 00:22:32.083966 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: python threads support enabled Oct 19 00:22:32.083966 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: your server socket listen backlog is limited to 100 connections Oct 19 00:22:32.083966 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: your mercy for graceful operations on workers is 90 seconds Oct 19 00:22:32.084357 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 00:22:32.084438 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: *** Operational MODE: preforking *** Oct 19 00:22:32.084689 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: *** uWSGI is running in multiple interpreter mode *** Oct 19 00:22:32.084689 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: spawned uWSGI master process (pid: 81467) Oct 19 00:22:32.084921 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 19 00:22:32.085833 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: spawned uWSGI worker 1 (pid: 81477, cores: 1) Oct 19 00:22:32.085922 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: spawned uWSGI worker 2 (pid: 81478, cores: 1) Oct 19 00:22:32.086440 dv-osbrick-master-4-iscsi devstack@keystone.service[81467]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 00:22:36.378139 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:22:36.378139 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: from cryptography.utils import int_from_bytes Oct 19 00:22:36.378915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:22:36.378915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: from cryptography.utils import int_from_bytes Oct 19 00:22:36.379590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:22:36.379590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: from cryptography.utils import int_from_bytes Oct 19 00:22:36.380039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:22:36.380039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: from cryptography.utils import int_from_bytes Oct 19 00:22:36.428159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:22:36.428324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:22:36.428514 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] command line args: [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:22:36.428778 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:22:36.428977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ================================================================================ {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:22:36.429227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] admin_token = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.429467 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] config_dir = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.429651 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.429829 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] config_source = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.429936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:22:36.430021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] debug = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.430131 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:22:36.430218 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.431421 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] command line args: [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:22:36.431487 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.431552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:22:36.431635 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.431703 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ================================================================================ {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:22:36.431762 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.431823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] admin_token = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.431879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.431940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] config_dir = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.431996 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] list_limit = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432058 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432116 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] log_config_append = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] config_source = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] debug = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432356 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] log_dir = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] log_file = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432571 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432628 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432683 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432766 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432856 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.432976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] list_limit = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433158 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433220 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] log_config_append = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433275 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433669 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] log_dir = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433759 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433888 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] log_file = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.433971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434166 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.434997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435195 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435873 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.435989 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] publish_errors = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436176 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436253 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436404 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436579 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.436820 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.437021 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.437112 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.437302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] standard_threads = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.437501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.437589 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.438305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] publish_errors = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.438418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.438502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.438622 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.438701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] use_journal = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.438801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] use_json = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.438972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] use_stderr = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.439059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.439136 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] use_syslog = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.439205 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.439360 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.439439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.439611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.439786 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.439905 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.440032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] standard_threads = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.440149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.440263 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.440383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.440508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.440508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.440736 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.440885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] use_journal = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.441004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.441119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] use_json = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.441242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.441357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] use_stderr = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.441357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] use_syslog = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.441579 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.441693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:22:36.441813 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.441936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442165 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442285 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442762 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.442989 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443108 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443223 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443471 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443709 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443822 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.443950 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444194 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444540 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.444921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445164 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445279 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445393 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445708 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445829 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.445944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446167 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446629 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446749 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.446990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447103 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447217 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447806 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.447920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448154 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448279 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448394 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448507 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.448884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449126 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449240 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449473 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449716 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449832 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.449953 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450296 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.450929 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451048 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451356 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451597 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451866 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.451990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452142 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452393 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452540 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452659 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.452935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453218 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453725 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.453981 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454223 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454336 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454451 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454587 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454711 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454835 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.454962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455295 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455511 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455758 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455880 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.455986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456223 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456329 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456570 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456796 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.456984 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457356 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457471 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457714 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457828 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.457951 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458649 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458649 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.458984 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459214 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459569 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459798 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.459913 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460040 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460519 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460640 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.460894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461126 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461240 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461355 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461842 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.461956 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462192 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462423 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462766 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.462954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463311 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463426 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.463920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464614 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.464897 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465017 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465145 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465394 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] auth.external = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465510 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465756 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465756 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.465979 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] auth.password = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] auth.token = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.466924 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467272 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467493 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.467968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468088 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] auth.external = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468328 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] credential.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468561 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468678 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468795 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.468919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] auth.password = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469148 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] auth.token = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469380 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469495 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469852 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.469968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470084 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470314 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470555 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470670 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.470785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471002 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471126 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] credential.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471601 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471840 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.471959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472407 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472530 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.472904 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473139 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473385 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473616 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473732 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.473974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474096 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474444 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474685 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.474916 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475286 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475404 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475520 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475759 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.475998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.476117 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.476232 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.476347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.476462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.476584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.476775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.476910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477027 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477144 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477375 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477503 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477625 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477743 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477859 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.477974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478090 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478333 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478456 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478573 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478696 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.478939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479358 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479474 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479720 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479839 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.479956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.480892 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481146 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481146 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481599 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481838 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.481956 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.482885 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483002 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483125 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483359 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.483949 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.484065 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.484180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.484303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.484420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485084 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485208 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485673 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.485922 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486271 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486393 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.486966 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487084 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487208 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487541 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.487895 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488358 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488473 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488597 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488716 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488864 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.488985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489463 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489579 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.489926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490167 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490398 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490513 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490754 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.490987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491766 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491999 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.491999 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.492224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.492343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.492459 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.492575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.492690 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.492806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.492996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493231 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493347 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493578 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493703 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493703 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.493924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494140 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494256 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494380 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494730 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494845 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.494962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495086 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495551 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495667 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.495908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496024 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496255 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496371 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.496980 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497694 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.497934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498177 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498293 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] role.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498766 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] role.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.498997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.499113 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.499238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.499356 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.499472 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.499588 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.499704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.499819 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.500006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.500126 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.500888 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501010 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501125 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501241 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.501946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502185 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502301 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502647 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502770 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] role.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.502886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] role.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503317 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.503888 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504003 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504245 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504360 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504475 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504828 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.504963 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505423 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.505897 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506598 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506598 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.506937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507051 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507166 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507640 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507758 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507873 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.507987 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508342 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508457 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508688 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.508975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509094 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509680 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509798 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.509914 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510030 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510145 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510261 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510385 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510618 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510735 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510859 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.510985 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511103 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511344 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.connection = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511807 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.511931 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512164 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512635 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512753 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.512885 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513120 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513363 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513481 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.513939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.514887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.515003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.515128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.515254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.515371 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.515487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.515603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.connection = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516226 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.516345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.517327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.517327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.517327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.517327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.517327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.517327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.517327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.518067 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.518067 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:22:36.518067 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:22:36.543140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.543369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.543594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.546288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.546523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.546748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.552439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.555957 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.581157 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.581387 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.582816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.583052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.634680 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.635209 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.684070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.684302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.685469 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.685707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.840183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.840413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.840633 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.840717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.840856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.840963 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.841090 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.841175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.841303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.841385 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.841595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.841814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.864500 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.864751 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865097 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865324 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865677 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.865971 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.866126 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.866345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.877837 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.878267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.890505 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.890700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.890877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891028 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891434 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891606 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891699 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891845 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81477) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.891969 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.892075 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.892298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81478) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 00:22:36.909162 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.909424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:22:36.909585 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.909771 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.909852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:22:36.909971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:22:36.910126 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.910245 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.910325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 00:22:36.910506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.910586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.910768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.911112 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.911291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.911376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.911607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.920806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.921109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.921272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.921380 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.921554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.921661 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.921829 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.922689 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.929331 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.929975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.932472 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.932472 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.932748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.932887 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.933066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.933180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.933352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.933482 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.933618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.933730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.933892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.934057 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.934167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.934269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.934425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.934542 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.934696 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.934822 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.935021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.935136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.935294 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.935565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.958120 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.959186 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.959583 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.959868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.960652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.960960 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.964504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.964790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.965098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.965608 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.965897 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.966180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.972298 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.972579 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.973353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.973644 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.978242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.978544 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.978836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.979127 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.979330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:36.979425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.979628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.979711 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.979918 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.980000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.980210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.980293 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.980494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.980773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.981073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.981346 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.995687 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.995968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.997043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.997328 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:36.999798 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.001498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.003068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.003365 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.004721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.005049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.007547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.009254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.010692 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.012422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.013896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.014198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.014485 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.014774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.015052 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.015354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.015696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.016612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.017062 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.017357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.017650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.017934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.032284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.032668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.032965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.033232 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.034485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.034777 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.035082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.035313 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.040262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.041819 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.042468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.043344 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.043619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.044008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.045595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.045877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.046459 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.046745 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.047062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.047360 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.047837 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.048807 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.049122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.049412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.049699 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.050751 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.058974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.059266 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.059545 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.059823 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.060209 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.060499 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.060781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.061203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.061491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.061777 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.062066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.062451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.062793 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.063275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.076285 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.079298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.079716 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.082272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.082604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.084041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.085190 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.085521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.085805 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.086204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.086663 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.088231 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.088518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.088943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.092502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.094040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.095683 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.096915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.097197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.097313 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.097600 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.097878 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.100048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.100448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.100749 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.101058 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.105619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.105912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.106194 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.108864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.109150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.109437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.113875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81477) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.114159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.114448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.114725 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.114998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.115269 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.115542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.115816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.116093 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.116371 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.116656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.117211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.117301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81478) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 00:22:37.117497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.117614 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81477) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.117782 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.118061 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.118338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.118616 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.118906 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.119195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.119470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.119743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.120033 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.120306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.120577 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.120867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81478) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 00:22:37.151797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3c30969c0 pid: 81477 (default app) Oct 19 00:22:37.155010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4232a-8982-4051-b5f5-2a99714ffa7e None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:37.155297 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4232a-8982-4051-b5f5-2a99714ffa7e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:37.155570 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4232a-8982-4051-b5f5-2a99714ffa7e None None] PATH_INFO: `/v3` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:37.155666 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3c30969c0 pid: 81478 (default app) Oct 19 00:22:37.159739 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Oct 19 00:22:37 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:43.907111 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a303-a611-4ea5-bda1-c3dd06aafd6a None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:43.907785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a303-a611-4ea5-bda1-c3dd06aafd6a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:43.907785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a303-a611-4ea5-bda1-c3dd06aafd6a None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:43.912256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:22:43.917577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:43.918102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:43.918102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:43.991336 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: INFO dbcounter [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] Registered counter for database keystone Oct 19 00:22:44.010217 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG oslo_db.sqlalchemy.engines [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:22:44.016891 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writer thread running {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:22:44.195273 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG passlib.handlers.bcrypt [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81477) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 00:22:44.195575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG passlib.handlers.bcrypt [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81477) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 00:22:44.253366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:44.254939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:44.382331 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:22:44.837076 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69a303-a611-4ea5-bda1-c3dd06aafd6a None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:44.907717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: INFO dbcounter [None req-5f69a303-a611-4ea5-bda1-c3dd06aafd6a None None] Registered counter for database keystone Oct 19 00:22:44.929693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG oslo_db.sqlalchemy.engines [None req-5f69a303-a611-4ea5-bda1-c3dd06aafd6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:22:44.936218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writer thread running {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:22:45.060169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69a303-a611-4ea5-bda1-c3dd06aafd6a None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:45.064775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e6989-aa8d-440e-b90d-10c33d1cfa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:45.065440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e6989-aa8d-440e-b90d-10c33d1cfa63 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:45.065726 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e6989-aa8d-440e-b90d-10c33d1cfa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:45.066005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e6989-aa8d-440e-b90d-10c33d1cfa63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:45.074224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e6989-aa8d-440e-b90d-10c33d1cfa63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:45.126420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING keystone.common.rbac_enforcer.enforcer [None req-556e6989-aa8d-440e-b90d-10c33d1cfa63 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 00:22:45.126713 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e6989-aa8d-440e-b90d-10c33d1cfa63 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:45.136005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 19 00:22:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:22:45.142742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:45.159761 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49daa0-5d0a-4c97-94a2-cafa1be87d9d None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:45.164416 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0cffa-b1db-4d65-9c6a-598c737fe936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:45.165534 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0cffa-b1db-4d65-9c6a-598c737fe936 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:45.165814 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0cffa-b1db-4d65-9c6a-598c737fe936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:45.166083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0cffa-b1db-4d65-9c6a-598c737fe936 admin admin] PATH_INFO: `/v3/projects/7112d45203474f9493cb8a682f790adf` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:45.167644 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0cffa-b1db-4d65-9c6a-598c737fe936 admin admin] RBAC: Authorizing `identity:get_project(project_id=7112d45203474f9493cb8a682f790adf)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:45.220616 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ace0cffa-b1db-4d65-9c6a-598c737fe936 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 00:22:45.220990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0cffa-b1db-4d65-9c6a-598c737fe936 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:45.225467 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 00:22:45 2022] GET /identity/v3/projects/7112d45203474f9493cb8a682f790adf => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:22:47.336697 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fdd9-962b-4351-8908-fb002b67a027 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:47.337245 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fdd9-962b-4351-8908-fb002b67a027 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:47.337245 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fdd9-962b-4351-8908-fb002b67a027 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:47.341356 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:47.346890 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835313-e7cf-4cdf-a165-ad0c27ab8ae9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:47.347312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835313-e7cf-4cdf-a165-ad0c27ab8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:47.347445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835313-e7cf-4cdf-a165-ad0c27ab8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:47.367181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-2f835313-e7cf-4cdf-a165-ad0c27ab8ae9 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:47.368692 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2f835313-e7cf-4cdf-a165-ad0c27ab8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:47.377494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:22:47.650649 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fdd9-962b-4351-8908-fb002b67a027 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:47.662905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fdd9-962b-4351-8908-fb002b67a027 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:47.667115 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19bce-175d-4954-8403-e7db6d31d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:47.667712 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19bce-175d-4954-8403-e7db6d31d5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:47.667996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19bce-175d-4954-8403-e7db6d31d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:47.668272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19bce-175d-4954-8403-e7db6d31d5ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:47.676804 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19bce-175d-4954-8403-e7db6d31d5ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:47.678595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19bce-175d-4954-8403-e7db6d31d5ef admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:47.687265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 19 00:22:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:22:47.693292 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f835313-e7cf-4cdf-a165-ad0c27ab8ae9 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:47.702239 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f835313-e7cf-4cdf-a165-ad0c27ab8ae9 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:47.707250 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb7ecc-f498-4952-8269-b26090c5c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:47.707873 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb7ecc-f498-4952-8269-b26090c5c2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:47.708147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb7ecc-f498-4952-8269-b26090c5c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:47.708421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb7ecc-f498-4952-8269-b26090c5c2f7 admin admin] PATH_INFO: `/v3/users/c0df48403b70414cb5833ddb3f121bc0` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:47.709797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb7ecc-f498-4952-8269-b26090c5c2f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=c0df48403b70414cb5833ddb3f121bc0)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:47.711606 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb7ecc-f498-4952-8269-b26090c5c2f7 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:47.713174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Oct 19 00:22:47 2022] GET /identity/v3/users/c0df48403b70414cb5833ddb3f121bc0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:49.896251 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee921201-1fd4-4efa-8723-abac9be70322 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:49.896794 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee921201-1fd4-4efa-8723-abac9be70322 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:49.896973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee921201-1fd4-4efa-8723-abac9be70322 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:49.898465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:49.903547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d328-aa83-4473-a7e8-0049a9435188 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:49.903946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d328-aa83-4473-a7e8-0049a9435188 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:49.904098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d328-aa83-4473-a7e8-0049a9435188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:49.922580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-77e8d328-aa83-4473-a7e8-0049a9435188 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:49.923756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-77e8d328-aa83-4473-a7e8-0049a9435188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:49.951642 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c35b7-b066-4ad8-9c5c-149ce3828659 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:49.951925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c35b7-b066-4ad8-9c5c-149ce3828659 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:49.952203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c35b7-b066-4ad8-9c5c-149ce3828659 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:49.954339 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:22:49.959872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:49.960160 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:49.960441 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.002020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG passlib.handlers.bcrypt [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81478) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 00:22:50.002417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG passlib.handlers.bcrypt [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81478) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 00:22:50.006243 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:22:50.052060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:50.053677 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:50.154381 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:22:50.274983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d328-aa83-4473-a7e8-0049a9435188 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.300551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:50.378768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d328-aa83-4473-a7e8-0049a9435188 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:50.411783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:50.412345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:50.412620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:50.412920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.420776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.424310 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:22:50.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:22:50.433973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:22:50.434787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:22:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:22:50.440774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.523426 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:50.524207 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90679c31-7ddb-4c16-a5b3-fd1726e30792 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:50.526699 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:50.542903 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1418ee6-fb91-48f5-b284-4d78a416d776 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:50.564003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:50.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:50.565168 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:50.565462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.566430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:50.567857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:50.576794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:50.577493 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:50.577803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:50.578076 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.578745 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:22:50.578836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.sql.core [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:22:50.578836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:22:50.578836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [parameters: {'id': 'bc764644a40648f58baf8c2619c1c802', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:22:50.578836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81478) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:22:50.579063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:50.580396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:50.592069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:22:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:22:50.597169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result.read() Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:22:50.598018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application yield resource Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise self.value Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application session.commit() Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:22:50.598891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:22:50.599708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:22:50.600590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result.read() Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:22:50.601374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [parameters: {'id': 'bc764644a40648f58baf8c2619c1c802', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:22:50.602152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:22:50.602857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:22:50.603765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.604332 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.604403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1137 bytes} [Wed Oct 19 00:22:50 2022] POST /identity/v3/domains => generated 190 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:22:50.604403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.704554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591800eb-6b61-43fe-adad-3178ad4e85aa None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:50.704944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4aa97-3dd6-401f-8d32-b91fa37dedb5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:50.738660 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:50.738861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:50.739284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:50.739507 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:50.739593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:50.739791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:50.739888 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] PATH_INFO: `/v3/users/c0df48403b70414cb5833ddb3f121bc0` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.740069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.740947 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] RBAC: Authorizing `identity:get_user(user_id=c0df48403b70414cb5833ddb3f121bc0)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:50.742412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:50.744122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:22:50 2022] GET /identity/v3/users/c0df48403b70414cb5833ddb3f121bc0 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:22:50.749369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.758633 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:50.760099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:50.763936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:22:50.776720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:22:50.777823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:22:50.778812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:22:50.778812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:22:50.778812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:50.778812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:22:50.784248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:50.853853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19547-062a-4d43-8c85-d2dc80af1c23 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:50.887139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe87c-08a8-4874-9476-a8f6943b966f None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:50.887439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:50.888079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:50.888365 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:50.888650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.889898 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:50.892197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:50.893968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:22:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:22:50.899460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:50.920425 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d4cc-6474-41a5-a24e-1da09fb810ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:50.921058 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d4cc-6474-41a5-a24e-1da09fb810ca None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:50.921337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d4cc-6474-41a5-a24e-1da09fb810ca None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:50.921641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d4cc-6474-41a5-a24e-1da09fb810ca None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:50.922304 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5d4cc-6474-41a5-a24e-1da09fb810ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:22:50.922614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5d4cc-6474-41a5-a24e-1da09fb810ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:50.923983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5d4cc-6474-41a5-a24e-1da09fb810ca None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:50.941497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:22:50.986687 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:51.007215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57a062-2a3d-4c05-9488-f7c89aa1eb70 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:51.042572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c8a15-d352-4975-b4bd-24d35ccb9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:51.043245 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c8a15-d352-4975-b4bd-24d35ccb9db7 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:51.043521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c8a15-d352-4975-b4bd-24d35ccb9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:51.043793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c8a15-d352-4975-b4bd-24d35ccb9db7 None admin] PATH_INFO: `/v3/domains/default/users/c0df48403b70414cb5833ddb3f121bc0/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:51.045804 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c8a15-d352-4975-b4bd-24d35ccb9db7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c0df48403b70414cb5833ddb3f121bc0, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:51.047997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c8a15-d352-4975-b4bd-24d35ccb9db7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:51.168647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Oct 19 00:22:50 2022] PUT /identity/v3/domains/default/users/c0df48403b70414cb5833ddb3f121bc0/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:22:53.653982 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843265-1b50-4495-8786-b2bd0b7390b8 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:53.654491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843265-1b50-4495-8786-b2bd0b7390b8 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:53.654562 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843265-1b50-4495-8786-b2bd0b7390b8 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:53.656136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:53.662460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582527a-c124-41d8-90c5-1d38f1a92c45 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:53.662882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582527a-c124-41d8-90c5-1d38f1a92c45 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:53.663044 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582527a-c124-41d8-90c5-1d38f1a92c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:53.694267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4582527a-c124-41d8-90c5-1d38f1a92c45 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:53.695878 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4582527a-c124-41d8-90c5-1d38f1a92c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:53.788588 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:22:53.798990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528720-faa0-4e25-8a80-4e80f7d91cd8 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:53.799280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528720-faa0-4e25-8a80-4e80f7d91cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:53.799545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528720-faa0-4e25-8a80-4e80f7d91cd8 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:53.801275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:53.806606 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf3e78-eca0-46fa-9bc3-f097c8e066be None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:53.806896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf3e78-eca0-46fa-9bc3-f097c8e066be None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:53.807170 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf3e78-eca0-46fa-9bc3-f097c8e066be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:53.837926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-04cf3e78-eca0-46fa-9bc3-f097c8e066be None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:53.839129 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-04cf3e78-eca0-46fa-9bc3-f097c8e066be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:53.918863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15b40-8770-4c83-bcde-32173d9f1ab5 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:53.919145 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15b40-8770-4c83-bcde-32173d9f1ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:53.919306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15b40-8770-4c83-bcde-32173d9f1ab5 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:53.920630 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:22:53.926059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:53.926320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc55e0-ade0-46f2-b496-1ff92711a969 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:53.926610 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc55e0-ade0-46f2-b496-1ff92711a969 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:53.926884 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc55e0-ade0-46f2-b496-1ff92711a969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:53.945772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:22:53.957432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-8adc55e0-ade0-46f2-b496-1ff92711a969 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:53.958638 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-8adc55e0-ade0-46f2-b496-1ff92711a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:54.071151 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:22:54.148320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf3e78-eca0-46fa-9bc3-f097c8e066be None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:54.287185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf3e78-eca0-46fa-9bc3-f097c8e066be None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:54.323479 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:54.324487 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.324991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.325456 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.334714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc55e0-ade0-46f2-b496-1ff92711a969 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:54.345573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:54.345573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:22:54.362701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:22:54.363566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:22:54.364341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:22:54.364341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:22:54.364341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:22:54.364341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:22:54.364555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:54.369642 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:54.451658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:54.519280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441f288-93f4-4d1c-8e63-4a9ebb7cb105 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:54.524281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc55e0-ade0-46f2-b496-1ff92711a969 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:54.558684 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:54.559534 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.559974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.560386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.560674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304023a-296f-4adf-b6ed-f738d3bc5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:54.561237 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:22:54.561636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304023a-296f-4adf-b6ed-f738d3bc5123 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.561832 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:54.561953 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304023a-296f-4adf-b6ed-f738d3bc5123 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.562217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304023a-296f-4adf-b6ed-f738d3bc5123 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.564498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:54.576354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304023a-296f-4adf-b6ed-f738d3bc5123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-e304023a-296f-4adf-b6ed-f738d3bc5123 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:22:54.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:22:54.585578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:22:54.586374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:22:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:22:54.587271 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7def-d563-4da9-aeed-d4c8ef15b39e None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.587609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7def-d563-4da9-aeed-d4c8ef15b39e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.587954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7def-d563-4da9-aeed-d4c8ef15b39e None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.589904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:54.594594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7def-d563-4da9-aeed-d4c8ef15b39e None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:54.597357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:22:54.598438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:54.676967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:54.715511 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe799c-480c-45ca-b766-a14152fe2300 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:54.719174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7def-d563-4da9-aeed-d4c8ef15b39e None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:54.729291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:54.754613 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dba797-d812-4cf5-8fb8-322a7172811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:54.755229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba797-d812-4cf5-8fb8-322a7172811a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.755522 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba797-d812-4cf5-8fb8-322a7172811a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba797-d812-4cf5-8fb8-322a7172811a None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.756465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dba797-d812-4cf5-8fb8-322a7172811a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:22:54.756785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dba797-d812-4cf5-8fb8-322a7172811a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:54.757915 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aa3be-5376-499c-9dc9-307090f405fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:54.758179 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dba797-d812-4cf5-8fb8-322a7172811a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:54.758521 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa3be-5376-499c-9dc9-307090f405fe None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.758798 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa3be-5376-499c-9dc9-307090f405fe None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.759070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa3be-5376-499c-9dc9-307090f405fe None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.759903 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aa3be-5376-499c-9dc9-307090f405fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:54.761619 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aa3be-5376-499c-9dc9-307090f405fe None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:54.767431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:54.773644 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59537-6ebf-434d-9195-b2d9d0fa2c83 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.774102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59537-6ebf-434d-9195-b2d9d0fa2c83 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.774282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59537-6ebf-434d-9195-b2d9d0fa2c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.793314 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-43a59537-6ebf-434d-9195-b2d9d0fa2c83 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:54.794494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-43a59537-6ebf-434d-9195-b2d9d0fa2c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:54.876942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:22:54.876942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59537-6ebf-434d-9195-b2d9d0fa2c83 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:54.885315 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 00:22:54 2022] POST /identity/v3/roles => generated 225 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:22:54.886850 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a04e28-f915-47c7-97ea-a1e348a07cab None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:54.887145 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a04e28-f915-47c7-97ea-a1e348a07cab None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:54.887422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a04e28-f915-47c7-97ea-a1e348a07cab None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:54.893628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 18/35] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:54.894568 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a04e28-f915-47c7-97ea-a1e348a07cab None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:55.018831 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a04e28-f915-47c7-97ea-a1e348a07cab None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:55.063505 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:55.080229 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8799d23-7a9e-4812-ae9a-8dfb167c50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:55.080935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799d23-7a9e-4812-ae9a-8dfb167c50ce None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.081218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799d23-7a9e-4812-ae9a-8dfb167c50ce None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.081491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799d23-7a9e-4812-ae9a-8dfb167c50ce None admin] PATH_INFO: `/v3/users/c0df48403b70414cb5833ddb3f121bc0` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.083985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8799d23-7a9e-4812-ae9a-8dfb167c50ce None admin] RBAC: Authorizing `identity:get_user(user_id=c0df48403b70414cb5833ddb3f121bc0)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:55.085612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8799d23-7a9e-4812-ae9a-8dfb167c50ce None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:55.088275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 19/36] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:22:54 2022] GET /identity/v3/users/c0df48403b70414cb5833ddb3f121bc0 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:55.090321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b0f5-ebd1-4871-89cf-16d2d5d9f927 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.090607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b0f5-ebd1-4871-89cf-16d2d5d9f927 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.090882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b0f5-ebd1-4871-89cf-16d2d5d9f927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.124609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-4b82b0f5-ebd1-4871-89cf-16d2d5d9f927 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:55.132962 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4b82b0f5-ebd1-4871-89cf-16d2d5d9f927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:55.177491 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59537-6ebf-434d-9195-b2d9d0fa2c83 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:55.180740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:55.215233 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:22:55.216760 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b0f5-ebd1-4871-89cf-16d2d5d9f927 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:55.221775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:55.222607 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.222921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.223333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.224326 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:55.226565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:55.261641 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 18/38] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:22:54 2022] POST /identity/v3/projects => generated 301 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:22:55.336187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b0f5-ebd1-4871-89cf-16d2d5d9f927 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:55.345609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:55.377508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:55.381951 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:55.382875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.383453 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.383873 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.385562 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:55.387630 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:55.389786 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 21/39] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:22:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:55.396306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:55.550159 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b9594-1a47-4cd5-b411-06ffc1003f1e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:55.551220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d001a-6217-4ba6-857e-518395419592 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:55.601675 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:55.602776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.603307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.603856 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.605080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.domain.id=default, user.id=c0df48403b70414cb5833ddb3f121bc0) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:22:55.605573 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:55.605673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45264cb-60b7-41d3-bcbb-043fe369018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:55.606335 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45264cb-60b7-41d3-bcbb-043fe369018f None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.606704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45264cb-60b7-41d3-bcbb-043fe369018f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.607054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45264cb-60b7-41d3-bcbb-043fe369018f None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.607812 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45264cb-60b7-41d3-bcbb-043fe369018f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:55.608076 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:55.610925 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45264cb-60b7-41d3-bcbb-043fe369018f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:55.619443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 22/40] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Oct 19 00:22:55 2022] GET /identity/v3/role_assignments?user.id=c0df48403b70414cb5833ddb3f121bc0&scope.domain.id=default&role.id=08d7ebb3d6044305874059d45f17c926 => generated 530 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:55.632402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 19/41] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 00:22:55 2022] POST /identity/v3/roles => generated 219 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:22:55.667927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:55.684462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02f032-ddbe-4e1d-87f7-14a138d0522c None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.685035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02f032-ddbe-4e1d-87f7-14a138d0522c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.685485 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02f032-ddbe-4e1d-87f7-14a138d0522c None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.687628 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 20/42] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:55.694713 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857348ae-721d-43b6-92dd-9479b2e5cff8 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.695170 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857348ae-721d-43b6-92dd-9479b2e5cff8 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.695594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857348ae-721d-43b6-92dd-9479b2e5cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.729775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-857348ae-721d-43b6-92dd-9479b2e5cff8 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:55.731400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-857348ae-721d-43b6-92dd-9479b2e5cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:55.751156 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:55.755102 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:55.834249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917e25e-37c1-4914-92d2-8e56b24b2ccf None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:55.847337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:22:55.878209 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:55.878858 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:55.879148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:55.879427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:55.880135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:55.881810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:55.902052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 00:22:55 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:22:56.205096 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857348ae-721d-43b6-92dd-9479b2e5cff8 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:56.329130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857348ae-721d-43b6-92dd-9479b2e5cff8 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:56.370619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5d77a-84f8-4064-b927-1d33ff29ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:56.371270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d77a-84f8-4064-b927-1d33ff29ea86 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:56.371556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d77a-84f8-4064-b927-1d33ff29ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:56.371836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d77a-84f8-4064-b927-1d33ff29ea86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:56.372975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d77a-84f8-4064-b927-1d33ff29ea86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:56.375251 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d77a-84f8-4064-b927-1d33ff29ea86 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:56.377117 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:22:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:56.383792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:56.487281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16fca-87c1-4ca4-b948-7dc6dd53267e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:56.506544 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:56.520689 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78451d97-c5ac-4f44-bb75-cd499612bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:56.521327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451d97-c5ac-4f44-bb75-cd499612bf3d None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:56.521609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451d97-c5ac-4f44-bb75-cd499612bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:56.521887 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451d97-c5ac-4f44-bb75-cd499612bf3d None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:56.522527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78451d97-c5ac-4f44-bb75-cd499612bf3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:56.523955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78451d97-c5ac-4f44-bb75-cd499612bf3d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:56.550798 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:22:56 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:22:58.672323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4544ff-d5fe-4c85-9b6d-74125e0f44b9 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:58.672857 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4544ff-d5fe-4c85-9b6d-74125e0f44b9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:58.672941 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4544ff-d5fe-4c85-9b6d-74125e0f44b9 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:58.674249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:22:58.679451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85e6f6-b659-4ea4-86a9-568bb36f7448 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:58.679815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85e6f6-b659-4ea4-86a9-568bb36f7448 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:58.680013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85e6f6-b659-4ea4-86a9-568bb36f7448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:58.698062 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ab85e6f6-b659-4ea4-86a9-568bb36f7448 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:22:58.699233 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ab85e6f6-b659-4ea4-86a9-568bb36f7448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:22:58.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:22:59.030660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4544ff-d5fe-4c85-9b6d-74125e0f44b9 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:59.048058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:59.131119 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4544ff-d5fe-4c85-9b6d-74125e0f44b9 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:59.163676 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5504f-a56e-47ed-9c0e-3710dd4e4426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:59.164291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5504f-a56e-47ed-9c0e-3710dd4e4426 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:59.164572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5504f-a56e-47ed-9c0e-3710dd4e4426 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:59.164869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5504f-a56e-47ed-9c0e-3710dd4e4426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:59.165969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5504f-a56e-47ed-9c0e-3710dd4e4426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:59.167414 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5504f-a56e-47ed-9c0e-3710dd4e4426 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:59.168961 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:22:59.175158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85e6f6-b659-4ea4-86a9-568bb36f7448 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:22:59.268147 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85e6f6-b659-4ea4-86a9-568bb36f7448 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:22:59.269584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:22:59.302427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8bb2-a24e-41d2-830b-ed1111965d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:22:59.303025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8bb2-a24e-41d2-830b-ed1111965d9c None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:22:59.303302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8bb2-a24e-41d2-830b-ed1111965d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:22:59.303573 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8bb2-a24e-41d2-830b-ed1111965d9c None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:22:59.304208 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8bb2-a24e-41d2-830b-ed1111965d9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:22:59.305660 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8bb2-a24e-41d2-830b-ed1111965d9c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:22:59.329727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 19 00:22:59 2022] POST /identity/v3/projects => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:23:01.472591 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbffe-1695-45c3-b385-975a0628fd72 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:01.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbffe-1695-45c3-b385-975a0628fd72 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:01.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbffe-1695-45c3-b385-975a0628fd72 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:01.474501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 25/51] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:01.479543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d771-a22a-4153-9686-83e5c7634c75 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:01.479945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d771-a22a-4153-9686-83e5c7634c75 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:01.480104 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d771-a22a-4153-9686-83e5c7634c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:01.499265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-2234d771-a22a-4153-9686-83e5c7634c75 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:01.500970 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-2234d771-a22a-4153-9686-83e5c7634c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:01.668818 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:01.938071 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbffe-1695-45c3-b385-975a0628fd72 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:02.020182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:02.038942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbffe-1695-45c3-b385-975a0628fd72 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:02.072109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c1b79-c0ae-4832-90bd-344d788763bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:02.072726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c1b79-c0ae-4832-90bd-344d788763bf None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:02.073038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c1b79-c0ae-4832-90bd-344d788763bf None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:02.073310 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c1b79-c0ae-4832-90bd-344d788763bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:02.074405 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c1b79-c0ae-4832-90bd-344d788763bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:02.075868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c1b79-c0ae-4832-90bd-344d788763bf None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:02.077442 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:02.082973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d771-a22a-4153-9686-83e5c7634c75 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:02.165093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:02.181022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d771-a22a-4153-9686-83e5c7634c75 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:02.213692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e7906-b7b9-4a31-a13a-44c1874446a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:02.214232 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7906-b7b9-4a31-a13a-44c1874446a1 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:02.214514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7906-b7b9-4a31-a13a-44c1874446a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:02.214788 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7906-b7b9-4a31-a13a-44c1874446a1 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:02.215434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e7906-b7b9-4a31-a13a-44c1874446a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:02.216910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e7906-b7b9-4a31-a13a-44c1874446a1 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:02.241863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 28/54] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:02 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:23:05.614270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9700d-f6ea-44e0-9bfd-d221dcb5cebb None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.615115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9700d-f6ea-44e0-9bfd-d221dcb5cebb None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.615535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9700d-f6ea-44e0-9bfd-d221dcb5cebb None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.617043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 27/55] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:05.638598 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a048f-2b15-43a6-881b-9cd0894ef602 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.639458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a048f-2b15-43a6-881b-9cd0894ef602 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.639875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a048f-2b15-43a6-881b-9cd0894ef602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.670113 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-8d8a048f-2b15-43a6-881b-9cd0894ef602 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:05.672153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-8d8a048f-2b15-43a6-881b-9cd0894ef602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:05.694865 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c218-a02c-4e3e-9964-0459ccfce22f None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.695503 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c218-a02c-4e3e-9964-0459ccfce22f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.695994 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c218-a02c-4e3e-9964-0459ccfce22f None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.698048 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 28/56] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:05.704503 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962574-ee82-4998-9c92-2b401ef88bc6 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.705480 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962574-ee82-4998-9c92-2b401ef88bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.706105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962574-ee82-4998-9c92-2b401ef88bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.727948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4a962574-ee82-4998-9c92-2b401ef88bc6 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:05.729501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4a962574-ee82-4998-9c92-2b401ef88bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:05.783434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 29/57] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:05.789273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0370-c18f-4736-9ff4-b4dffe810514 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.791530 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0370-c18f-4736-9ff4-b4dffe810514 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.792104 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0370-c18f-4736-9ff4-b4dffe810514 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.794467 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:05.802118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917503-643e-41c3-adcf-54327e7c2f7e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.804795 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917503-643e-41c3-adcf-54327e7c2f7e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.805729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917503-643e-41c3-adcf-54327e7c2f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.841987 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-e7917503-643e-41c3-adcf-54327e7c2f7e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:05.846144 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e7917503-643e-41c3-adcf-54327e7c2f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:05.873405 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:05.898508 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6916b06-d68e-4a8f-8eff-e00a36a40a7b None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.899102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6916b06-d68e-4a8f-8eff-e00a36a40a7b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.899612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6916b06-d68e-4a8f-8eff-e00a36a40a7b None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.901176 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 30/60] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:05.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c388b-c607-4cc0-8e45-8fca84438098 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:05.914772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c388b-c607-4cc0-8e45-8fca84438098 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:05.915241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c388b-c607-4cc0-8e45-8fca84438098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:05.937137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:05.939301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 31/61] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:05.960883 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-573c388b-c607-4cc0-8e45-8fca84438098 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:05.962201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-573c388b-c607-4cc0-8e45-8fca84438098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:06.063660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:06.095638 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917503-643e-41c3-adcf-54327e7c2f7e None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.234657 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917503-643e-41c3-adcf-54327e7c2f7e None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.272189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bebad2-ec6b-4b63-8ccc-04e7b53a6da3 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.272713 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bebad2-ec6b-4b63-8ccc-04e7b53a6da3 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.273189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bebad2-ec6b-4b63-8ccc-04e7b53a6da3 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.273921 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.274566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.274847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.275122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.275733 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:06.286068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901e4d8-cf24-4dfe-a67b-957e9c7e2760 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.286833 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901e4d8-cf24-4dfe-a67b-957e9c7e2760 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.287274 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901e4d8-cf24-4dfe-a67b-957e9c7e2760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.292877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:06.295199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:06.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:06.296783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 32/64] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:06.301889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.321118 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-9901e4d8-cf24-4dfe-a67b-957e9c7e2760 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:06.322663 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9901e4d8-cf24-4dfe-a67b-957e9c7e2760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:06.325896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:06.366053 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:06.396043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:06.396919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901e4d8-cf24-4dfe-a67b-957e9c7e2760 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.410853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee9624-f36f-4854-8b66-1c347e2f1741 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.446530 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.447141 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.447421 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.447704 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.448366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] RBAC: Adding query filter params (name=member) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:06.448671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:06.450082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:06.462883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 33/66] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:06.463708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.508723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901e4d8-cf24-4dfe-a67b-957e9c7e2760 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.546315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.546957 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.547241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.547626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.556565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:06.560017 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:06.566436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:06.567262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:06.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:06.568570 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952210-817b-4012-bb65-199200e2b848 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.568643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 34/67] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:06.572988 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.592462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:06.605454 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.606175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.606496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.606749 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.617645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:06.622475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:06.623290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:06.624048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:06.625713 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.681167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6bd5-5f98-4017-8b47-de02476f87cf None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.715627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.716256 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.716542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.716817 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.727033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:06.730227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f671b5-c484-453f-8c44-01d713a01ac5 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:06.731800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:06.732793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:06.733595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:06.734450 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.769625 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.770177 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.770462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.770739 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] PATH_INFO: `/v3/users/9e45f34588cb4e95a03f2a9be447c9af` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.785674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] RBAC: Authorizing `identity:get_user(user_id=9e45f34588cb4e95a03f2a9be447c9af)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:06.787547 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:06.789193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/users/9e45f34588cb4e95a03f2a9be447c9af => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:06.790040 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.793815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:06.831146 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:06.835765 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8702426-66d9-4a41-834d-959e65d584de None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.870465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.871274 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.871560 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.871839 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.872509 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:06.872817 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:06.874244 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:06.882748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:06.883541 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.889489 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92338941-319e-4470-9f5f-216f13ea7649 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:06.924917 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:06.925528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:06.925814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:06.926088 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:06.926755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:06.927234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:06.929028 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:06.939768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:06.940589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:06.982661 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3438-30a4-4ac7-9781-f838a2ab9b81 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.005086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.017167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.017803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.018373 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.018373 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.019476 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.021020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.022543 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.023299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.042886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f3b7c-50b9-4b1b-9902-4f304ece3e04 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.044433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.077146 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.078300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.078583 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.078861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.079524 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:07.079825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.081232 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.089013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 37/74] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.089796 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.128343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bba3c8-3869-4342-b2e8-5f6afe62a2ef None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.162215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.163121 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.163395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.164519 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.166004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.167633 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:07 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.168395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.194649 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46347-d4ac-49e2-ac03-17ded6ff67d6 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.224770 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.228546 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.229206 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.229491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.229775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] PATH_INFO: `/v3/users/c0df48403b70414cb5833ddb3f121bc0` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.230912 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] RBAC: Authorizing `identity:get_user(user_id=c0df48403b70414cb5833ddb3f121bc0)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.232357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.234537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 38/76] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:07 2022] GET /identity/v3/users/c0df48403b70414cb5833ddb3f121bc0 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.235390 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.269321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf738d-f3a5-46d7-820f-bc39bd181315 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.269487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.304565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.305227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.305512 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.305790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] PATH_INFO: `/v3/users/9e45f34588cb4e95a03f2a9be447c9af` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.306931 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] RBAC: Authorizing `identity:get_user(user_id=9e45f34588cb4e95a03f2a9be447c9af)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.308388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.310024 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:07 2022] GET /identity/v3/users/9e45f34588cb4e95a03f2a9be447c9af => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.310781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.340407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30ad5-cd03-42a6-b302-02d5ffd110db None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.376021 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.376627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.376942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.377223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.377872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.379331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.400854 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 39/78] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:07 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:07.402070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.421015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c9a8e-167d-49b0-844f-501c39d4bb14 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.463984 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.464858 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.465258 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.465636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] PATH_INFO: `/v3/users/9e45f34588cb4e95a03f2a9be447c9af` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.466988 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] RBAC: Authorizing `identity:get_user(user_id=9e45f34588cb4e95a03f2a9be447c9af)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.468727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.475726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:07 2022] GET /identity/v3/users/9e45f34588cb4e95a03f2a9be447c9af => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.475726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.520400 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.538855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c587-6509-47e3-bf0f-a65a722e7d88 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.582462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.583859 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.584149 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.584430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e/users/9e45f34588cb4e95a03f2a9be447c9af/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.586412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] RBAC: Authorizing `identity:create_grant(project_id=393fe81231a348e7b30284cd804f160e, user_id=9e45f34588cb4e95a03f2a9be447c9af, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.586955 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a4a81-c29d-437a-9e9b-542622e7a958 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.588775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.605655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 40/80] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:07 2022] PUT /identity/v3/projects/393fe81231a348e7b30284cd804f160e/users/9e45f34588cb4e95a03f2a9be447c9af/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:07.609929 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.627998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.628670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.628998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.629289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.630511 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.632019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.633850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 41/81] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:07 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.634663 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.731688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.763751 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce1e8-7a9c-48bb-a20c-20b188353742 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.792809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0518-b1c1-4a62-b2fa-ceb21a72f268 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.805529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.806375 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.806741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.807126 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.808408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.810040 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.811874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 41/82] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:07 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.813626 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.834270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.835237 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:07.835444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.835691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.835965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] PATH_INFO: `/v3/projects/872b15b6eb5c4e28aa3ad3185a27a12d` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.837425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] RBAC: Authorizing `identity:get_project(project_id=872b15b6eb5c4e28aa3ad3185a27a12d)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.838960 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:07.841305 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 42/83] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:07 2022] GET /identity/v3/projects/872b15b6eb5c4e28aa3ad3185a27a12d => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:07.842356 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:07.941966 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc878a-b0a4-4954-80fa-3f8a3c7d2eca None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.973864 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fbc47-870e-4d1a-89e2-22b5d7eb4b12 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:07.979553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:07.980463 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:07.980989 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:07.981591 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e/users/c0df48403b70414cb5833ddb3f121bc0/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:07.984092 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] RBAC: Authorizing `identity:create_grant(project_id=393fe81231a348e7b30284cd804f160e, user_id=c0df48403b70414cb5833ddb3f121bc0, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:07.985886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:08.002605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 42/84] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:07 2022] PUT /identity/v3/projects/393fe81231a348e7b30284cd804f160e/users/c0df48403b70414cb5833ddb3f121bc0/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:08.003958 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:08.007721 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:08.021973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8ec6e-220e-4b44-b6f6-a4182b91ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:08.023021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8ec6e-220e-4b44-b6f6-a4182b91ba03 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:08.023275 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8ec6e-220e-4b44-b6f6-a4182b91ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:08.023580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8ec6e-220e-4b44-b6f6-a4182b91ba03 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e/users/9e45f34588cb4e95a03f2a9be447c9af/roles/f411ad648adf4ef4bb52b64d0f648fff` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:08.030336 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8ec6e-220e-4b44-b6f6-a4182b91ba03 None admin] RBAC: Authorizing `identity:create_grant(project_id=393fe81231a348e7b30284cd804f160e, user_id=9e45f34588cb4e95a03f2a9be447c9af, role_id=f411ad648adf4ef4bb52b64d0f648fff)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:08.032666 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8ec6e-220e-4b44-b6f6-a4182b91ba03 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:08.067767 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 43/85] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:07 2022] PUT /identity/v3/projects/393fe81231a348e7b30284cd804f160e/users/9e45f34588cb4e95a03f2a9be447c9af/roles/f411ad648adf4ef4bb52b64d0f648fff => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:08.107836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:08.137933 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1d71-89ac-4a72-92e4-efd827300d84 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:08.177575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e819dc-ad16-4c00-84ff-155d3982ef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:08.178707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e819dc-ad16-4c00-84ff-155d3982ef06 None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:08.179213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e819dc-ad16-4c00-84ff-155d3982ef06 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:08.179689 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e819dc-ad16-4c00-84ff-155d3982ef06 None admin] PATH_INFO: `/v3/projects/872b15b6eb5c4e28aa3ad3185a27a12d/users/9e45f34588cb4e95a03f2a9be447c9af/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:08.182097 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e819dc-ad16-4c00-84ff-155d3982ef06 None admin] RBAC: Authorizing `identity:create_grant(project_id=872b15b6eb5c4e28aa3ad3185a27a12d, user_id=9e45f34588cb4e95a03f2a9be447c9af, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:08.183824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e819dc-ad16-4c00-84ff-155d3982ef06 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:08.203000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 43/86] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:08 2022] PUT /identity/v3/projects/872b15b6eb5c4e28aa3ad3185a27a12d/users/9e45f34588cb4e95a03f2a9be447c9af/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:10.465259 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753adec8-066f-494a-a102-4d9d7b81360b None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:10.465801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753adec8-066f-494a-a102-4d9d7b81360b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:10.465801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753adec8-066f-494a-a102-4d9d7b81360b None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:10.467300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 44/87] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:10.471553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a1d2-3154-4a15-8a6b-0af2352c24cd None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:10.471964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a1d2-3154-4a15-8a6b-0af2352c24cd None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:10.472134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a1d2-3154-4a15-8a6b-0af2352c24cd None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:10.473578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 44/88] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:10.474597 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751abd9-9f32-4824-b752-9d658c730219 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:10.474877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751abd9-9f32-4824-b752-9d658c730219 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:10.475151 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751abd9-9f32-4824-b752-9d658c730219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:10.498986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23cf6-61cb-443c-9f83-c82e8845394d None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:10.499604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23cf6-61cb-443c-9f83-c82e8845394d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:10.499891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23cf6-61cb-443c-9f83-c82e8845394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:10.505559 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-0751abd9-9f32-4824-b752-9d658c730219 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:10.506751 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-0751abd9-9f32-4824-b752-9d658c730219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:10.532962 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-f1a23cf6-61cb-443c-9f83-c82e8845394d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:10.535840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-f1a23cf6-61cb-443c-9f83-c82e8845394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:10.669777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 45/89] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:10.691433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 45/90] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:10.966100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751abd9-9f32-4824-b752-9d658c730219 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.105964 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751abd9-9f32-4824-b752-9d658c730219 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:11.136643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:11.159937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:11.161043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.161807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.162291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.179885 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:11.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:11.186238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:11.187535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:11.198243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23cf6-61cb-443c-9f83-c82e8845394d None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.209617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:11.212380 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.305892 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:11.348165 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23cf6-61cb-443c-9f83-c82e8845394d None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:11.369674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cd9e8-76d4-4f3e-bc5e-8680a912fc64 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:11.390586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372779-4de4-4f24-b9c8-b5b5b8c595e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:11.391453 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372779-4de4-4f24-b9c8-b5b5b8c595e2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.391664 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372779-4de4-4f24-b9c8-b5b5b8c595e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.391946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372779-4de4-4f24-b9c8-b5b5b8c595e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.392638 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372779-4de4-4f24-b9c8-b5b5b8c595e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:11.393003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372779-4de4-4f24-b9c8-b5b5b8c595e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:11.394427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372779-4de4-4f24-b9c8-b5b5b8c595e2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:11.403348 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:11.409214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3595-8eb6-4b26-b424-a8288f211513 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.409214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3595-8eb6-4b26-b424-a8288f211513 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.409214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3595-8eb6-4b26-b424-a8288f211513 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.409214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 47/93] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:11.410012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04d2d-e201-4af2-8607-707f39d21d50 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.410012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04d2d-e201-4af2-8607-707f39d21d50 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.410252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04d2d-e201-4af2-8607-707f39d21d50 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.415858 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 48/94] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:11.419910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04d2d-e201-4af2-8607-707f39d21d50 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.426927 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e1ae3-0130-4e21-9c6c-064e89faab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:11.427763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1ae3-0130-4e21-9c6c-064e89faab67 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.428198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1ae3-0130-4e21-9c6c-064e89faab67 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.429100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1ae3-0130-4e21-9c6c-064e89faab67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.445183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e1ae3-0130-4e21-9c6c-064e89faab67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-117e1ae3-0130-4e21-9c6c-064e89faab67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:11.450702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:11.451634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:11.452464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:11.454345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a47d0-3e70-4dbb-93b3-af02552d39a9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.454699 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a47d0-3e70-4dbb-93b3-af02552d39a9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.455074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a47d0-3e70-4dbb-93b3-af02552d39a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.474728 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-8f7a47d0-3e70-4dbb-93b3-af02552d39a9 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:11.475795 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8f7a47d0-3e70-4dbb-93b3-af02552d39a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:11.512024 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:11.542327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04d2d-e201-4af2-8607-707f39d21d50 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:11.556345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 48/96] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:11.557683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a2f23-8105-4e2c-84b9-f334cc31716f None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.557972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a2f23-8105-4e2c-84b9-f334cc31716f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.558249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a2f23-8105-4e2c-84b9-f334cc31716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.579420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-665a2f23-8105-4e2c-84b9-f334cc31716f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:11.580627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-665a2f23-8105-4e2c-84b9-f334cc31716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:11.586646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:11.597681 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:11.598693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.599172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.599736 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] PATH_INFO: `/v3/users/7d0242a63a364ccfae6e6cd1603e51d0` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.619461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] RBAC: Authorizing `identity:get_user(user_id=7d0242a63a364ccfae6e6cd1603e51d0)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:11.622647 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:11.625427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 49/97] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:11 2022] GET /identity/v3/users/7d0242a63a364ccfae6e6cd1603e51d0 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:11.626442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.660020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 49/98] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:11.670249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf697c-8d49-43f0-916f-6119bf2b00d7 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.670540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf697c-8d49-43f0-916f-6119bf2b00d7 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.670819 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf697c-8d49-43f0-916f-6119bf2b00d7 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.673091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 50/99] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:11.677280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf697c-8d49-43f0-916f-6119bf2b00d7 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.759232 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76753e-1fdc-4f4e-bc0a-b4c8a1d07475 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:11.795962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:11.804223 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf697c-8d49-43f0-916f-6119bf2b00d7 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:11.807920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa44d-f308-41c1-9014-9907661b5492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:11.808781 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa44d-f308-41c1-9014-9907661b5492 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.809321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa44d-f308-41c1-9014-9907661b5492 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.809785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa44d-f308-41c1-9014-9907661b5492 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.810641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa44d-f308-41c1-9014-9907661b5492 None admin] RBAC: Adding query filter params (name=member) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:11.811137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa44d-f308-41c1-9014-9907661b5492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:11.814544 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa44d-f308-41c1-9014-9907661b5492 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:11.825731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 50/100] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:11.827581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62db14-694c-4624-b9fb-1c1f8f4532c1 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.828068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62db14-694c-4624-b9fb-1c1f8f4532c1 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.828749 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62db14-694c-4624-b9fb-1c1f8f4532c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.844248 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e5a1-4561-4082-92d9-03a0029d5ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:11.844913 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e5a1-4561-4082-92d9-03a0029d5ffd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.845198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e5a1-4561-4082-92d9-03a0029d5ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.845474 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e5a1-4561-4082-92d9-03a0029d5ffd None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.846593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e5a1-4561-4082-92d9-03a0029d5ffd None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:11.848048 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e5a1-4561-4082-92d9-03a0029d5ffd None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:11.849560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-0f62db14-694c-4624-b9fb-1c1f8f4532c1 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:11.849752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 51/101] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:11 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:11.850821 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a375b0-7f56-4924-ac6d-5155e3bfc3bc None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:11.851107 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a375b0-7f56-4924-ac6d-5155e3bfc3bc None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:11.851384 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a375b0-7f56-4924-ac6d-5155e3bfc3bc None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:11.851774 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-0f62db14-694c-4624-b9fb-1c1f8f4532c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:11.852576 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 52/102] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:11.853300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a375b0-7f56-4924-ac6d-5155e3bfc3bc None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.901027 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:11.928422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:11.935845 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62db14-694c-4624-b9fb-1c1f8f4532c1 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:11.967103 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a375b0-7f56-4924-ac6d-5155e3bfc3bc None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.007857 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.008489 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.008768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.009149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] PATH_INFO: `/v3/users/9e45f34588cb4e95a03f2a9be447c9af` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.010238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] RBAC: Authorizing `identity:get_user(user_id=9e45f34588cb4e95a03f2a9be447c9af)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:12.011625 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:12.013233 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 53/104] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:11 2022] GET /identity/v3/users/9e45f34588cb4e95a03f2a9be447c9af => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:12.019005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.052672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62db14-694c-4624-b9fb-1c1f8f4532c1 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.056025 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.090322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278975-6263-4c09-b29b-e9a9a335b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.090967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278975-6263-4c09-b29b-e9a9a335b6de None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.091359 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278975-6263-4c09-b29b-e9a9a335b6de None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.091635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278975-6263-4c09-b29b-e9a9a335b6de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.092727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc278975-6263-4c09-b29b-e9a9a335b6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:12.094729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc278975-6263-4c09-b29b-e9a9a335b6de None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:12.096283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 52/105] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:12.097514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005e60e-7cb9-4030-8a7e-a0a59cc7525d None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.097801 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005e60e-7cb9-4030-8a7e-a0a59cc7525d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.098072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005e60e-7cb9-4030-8a7e-a0a59cc7525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.115945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-5005e60e-7cb9-4030-8a7e-a0a59cc7525d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:12.117142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-5005e60e-7cb9-4030-8a7e-a0a59cc7525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:12.126082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207efe31-a9e8-4878-aeb3-5a55c1a54a43 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.161902 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.162575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.162862 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.163141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e/users/7d0242a63a364ccfae6e6cd1603e51d0/roles/88d42d2fdec94576b571dd7a1624a685` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.164469 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.165438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=393fe81231a348e7b30284cd804f160e, user_id=7d0242a63a364ccfae6e6cd1603e51d0, role_id=88d42d2fdec94576b571dd7a1624a685)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:12.167229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:12.182307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 54/106] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:12 2022] PUT /identity/v3/projects/393fe81231a348e7b30284cd804f160e/users/7d0242a63a364ccfae6e6cd1603e51d0/roles/88d42d2fdec94576b571dd7a1624a685 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:12.182897 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.204766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 53/107] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:12.204766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005e60e-7cb9-4030-8a7e-a0a59cc7525d None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.330087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.336914 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bb595-51e5-4964-acb2-5b5384d5b0a2 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.343756 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005e60e-7cb9-4030-8a7e-a0a59cc7525d None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.380215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.380865 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.381163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.381445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.389170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.390298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.390608 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.390974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.396969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:12.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:12.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:12.403962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 55/108] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:23:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:12.404609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.445834 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.475640 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:12.477562 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:12.529502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793bea8-983e-45c3-9332-c9492708fc32 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.567530 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.568140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.568424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.568701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.569373 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:12.570831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:12.588345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 54/109] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:12.589244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.602942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 56/110] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:23:12 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:12.604015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.622993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.692565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.719876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a228687-f06a-4a1d-8a27-cf14d6baf1ed None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.759079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.759850 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.760202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.760553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.764046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba16cc-176b-4222-8c11-a19921decea3 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.777356 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:12.782523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:12.783407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:12.784139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 55/111] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:23:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:12.785322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.815127 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.815851 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.816135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.816555 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.817339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:12.817654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:12.819098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:12.829936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 57/112] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:12.831019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:12.915651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4a03f-4deb-45a0-a5d2-f48bad2c398b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.922981 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.957203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:12.958413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:12.959236 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:12.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:12.963376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:12.965820 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea1980-d84b-4229-87ed-d55c97445902 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:12.976227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:12.982604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:12.983532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:12.984427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:12.987553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 56/113] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:12.988644 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.007301 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.007940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.008240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.008985 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.010401 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.012109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.014159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 58/114] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:12 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:13.016654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.119750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838901d-bccd-42e1-a6d0-6c6b95619d11 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.120234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5eb20-c340-4ab8-85b4-e740614e2ce7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.159433 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.160859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.161589 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.162270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] PATH_INFO: `/v3/users/9e45f34588cb4e95a03f2a9be447c9af` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.163710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] RBAC: Authorizing `identity:get_user(user_id=9e45f34588cb4e95a03f2a9be447c9af)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.165587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.166128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.166807 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.167159 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.167518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.168181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 59/115] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/users/9e45f34588cb4e95a03f2a9be447c9af => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:13.168291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:13.168623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.169421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.170263 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.181442 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:13.181670 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 57/116] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:13.183152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.254550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:13.298639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6fe4d-4685-46ba-9755-4d87627e71dd None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.304413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b06b7c-2e49-44bf-a5dc-56daaf07d49e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.335529 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.336224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.336577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.336973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.337877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] RBAC: Adding query filter params (name=member) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:13.338280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.339846 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.343556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.344164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.344443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.344719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.345479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] RBAC: Adding query filter params (role.id=c1be01f06d6d4babaadc2a4809ef9dfc, scope.project.id=393fe81231a348e7b30284cd804f160e, user.id=9e45f34588cb4e95a03f2a9be447c9af) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:13.345785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.347321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.349688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 60/117] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:13.350664 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.359293 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/role_assignments?user.id=9e45f34588cb4e95a03f2a9be447c9af&scope.project.id=393fe81231a348e7b30284cd804f160e&role.id=c1be01f06d6d4babaadc2a4809ef9dfc => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:13.359983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.463495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:13.514385 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c24d-b689-45be-8781-16c71962f15b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.538774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994897e3-dff9-4acd-ba1d-9df3af7bfbdb None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.562409 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:13.581052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.581052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.581052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.581052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] PATH_INFO: `/v3/users/c0df48403b70414cb5833ddb3f121bc0` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.582109 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] RBAC: Authorizing `identity:get_user(user_id=c0df48403b70414cb5833ddb3f121bc0)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.583554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.586771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 59/119] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/users/c0df48403b70414cb5833ddb3f121bc0 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:13.588506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.596961 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.597856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.598356 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.598841 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.690080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.691557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.743450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5e73a-914c-4f8b-882a-b253bfd74dae None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.787719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:13.794540 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.795418 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.795895 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.796393 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] PATH_INFO: `/v3/users/9e45f34588cb4e95a03f2a9be447c9af` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.797798 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] RBAC: Authorizing `identity:get_user(user_id=9e45f34588cb4e95a03f2a9be447c9af)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:13.799872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:13.802320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 60/120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/users/9e45f34588cb4e95a03f2a9be447c9af => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:13.803424 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.836881 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 61/121] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:13.838351 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:13.877032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:13.927687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0ada-96a9-4ef8-9d3b-8540e7975df2 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.952133 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961bd06-5343-4f86-b1ce-4312b6d2faf5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:13.966428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.967127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.967637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.968047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:13.990317 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:13.991235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:13.991692 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:13.992142 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.030116 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:14.048869 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.050449 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.069107 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.070870 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.119207 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:14.174203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 61/122] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:14.176213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:14.189957 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 62/123] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:14.191113 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:14.270779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:14.305810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac1bc-1fed-4eed-b4d1-cc451776cf48 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:14.310442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaca890-5f0f-4125-8bbc-3806b2eb3bc7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:14.347881 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:14.348922 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.349587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.350097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.350823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:14.351485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.351771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.352048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.352282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.353189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.354170 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.354681 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.356218 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 63/124] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:14 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:14.356623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 62/125] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:14 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:14.357365 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:14.365570 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:14.396678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:14.480937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe59b31-1d5a-4b05-9b31-378aa103308c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:14.494728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5369ff-6033-4354-aa4c-01480c56027e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:14.525694 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:14.526345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.526630 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.526906 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] PATH_INFO: `/v3/projects/872b15b6eb5c4e28aa3ad3185a27a12d` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.528178 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] RBAC: Authorizing `identity:get_project(project_id=872b15b6eb5c4e28aa3ad3185a27a12d)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.529651 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.531970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 64/126] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:14 2022] GET /identity/v3/projects/872b15b6eb5c4e28aa3ad3185a27a12d => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:14.532351 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef87c6-aa78-4e6e-8452-3ac6cc955492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:14.532745 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:14.533314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef87c6-aa78-4e6e-8452-3ac6cc955492 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.533734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef87c6-aa78-4e6e-8452-3ac6cc955492 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.534144 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef87c6-aa78-4e6e-8452-3ac6cc955492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.535023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef87c6-aa78-4e6e-8452-3ac6cc955492 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=393fe81231a348e7b30284cd804f160e, user.id=c0df48403b70414cb5833ddb3f121bc0) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:14.535474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef87c6-aa78-4e6e-8452-3ac6cc955492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.536200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:14.537841 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef87c6-aa78-4e6e-8452-3ac6cc955492 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.544458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 63/127] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:14 2022] GET /identity/v3/role_assignments?user.id=c0df48403b70414cb5833ddb3f121bc0&scope.project.id=393fe81231a348e7b30284cd804f160e&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:14.545994 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192405-5a25-40f5-adba-fe6df5f7b240 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.546505 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192405-5a25-40f5-adba-fe6df5f7b240 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.546938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192405-5a25-40f5-adba-fe6df5f7b240 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.548343 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 64/128] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:14.549281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8192405-5a25-40f5-adba-fe6df5f7b240 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:14.648267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db76b-25ac-46e5-83e2-1e4d52aeab31 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:14.665165 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:14.680476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8192405-5a25-40f5-adba-fe6df5f7b240 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:14.687567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e1f2e-f7eb-4649-bb7d-c1064dfb0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:14.688301 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1f2e-f7eb-4649-bb7d-c1064dfb0e9c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.688658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1f2e-f7eb-4649-bb7d-c1064dfb0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.689035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1f2e-f7eb-4649-bb7d-c1064dfb0e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.689858 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e1f2e-f7eb-4649-bb7d-c1064dfb0e9c None admin] RBAC: Adding query filter params (role.id=f411ad648adf4ef4bb52b64d0f648fff, scope.project.id=393fe81231a348e7b30284cd804f160e, user.id=9e45f34588cb4e95a03f2a9be447c9af) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:14.690242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e1f2e-f7eb-4649-bb7d-c1064dfb0e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.691834 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e1f2e-f7eb-4649-bb7d-c1064dfb0e9c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.699942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 65/129] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:14 2022] GET /identity/v3/role_assignments?user.id=9e45f34588cb4e95a03f2a9be447c9af&scope.project.id=393fe81231a348e7b30284cd804f160e&role.id=f411ad648adf4ef4bb52b64d0f648fff => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:14.701339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8b5a-29a4-4fd1-91c8-499f2443eaf2 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8b5a-29a4-4fd1-91c8-499f2443eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.702049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8b5a-29a4-4fd1-91c8-499f2443eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.727853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-c29d8b5a-29a4-4fd1-91c8-499f2443eaf2 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:14.727853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c29d8b5a-29a4-4fd1-91c8-499f2443eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:14.734918 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddc2b4-73ce-4a10-b943-bc3cc6203214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:14.735549 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc2b4-73ce-4a10-b943-bc3cc6203214 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:14.735831 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc2b4-73ce-4a10-b943-bc3cc6203214 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:14.736105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc2b4-73ce-4a10-b943-bc3cc6203214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:14.736920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddc2b4-73ce-4a10-b943-bc3cc6203214 None admin] RBAC: Adding query filter params (role.id=c1be01f06d6d4babaadc2a4809ef9dfc, scope.project.id=872b15b6eb5c4e28aa3ad3185a27a12d, user.id=9e45f34588cb4e95a03f2a9be447c9af) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:14.737238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddc2b4-73ce-4a10-b943-bc3cc6203214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:14.738789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddc2b4-73ce-4a10-b943-bc3cc6203214 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:14.759311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 65/130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:14 2022] GET /identity/v3/role_assignments?user.id=9e45f34588cb4e95a03f2a9be447c9af&scope.project.id=872b15b6eb5c4e28aa3ad3185a27a12d&role.id=c1be01f06d6d4babaadc2a4809ef9dfc => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:14.807559 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 66/131] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:14.808134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:15.084407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55ea1-7523-4b27-b27d-2d45066570bf None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.084696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55ea1-7523-4b27-b27d-2d45066570bf None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.085003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55ea1-7523-4b27-b27d-2d45066570bf None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.086351 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 66/132] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:15.089367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d8b5a-29a4-4fd1-91c8-499f2443eaf2 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:15.091101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd125c-cde3-4ee3-aff3-8deccd9a9382 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.091386 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd125c-cde3-4ee3-aff3-8deccd9a9382 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.091662 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd125c-cde3-4ee3-aff3-8deccd9a9382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.109137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-c3dd125c-cde3-4ee3-aff3-8deccd9a9382 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:15.110335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-c3dd125c-cde3-4ee3-aff3-8deccd9a9382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:15.175599 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 67/133] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:15.191439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d8b5a-29a4-4fd1-91c8-499f2443eaf2 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:15.225541 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:15.226167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.226452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.237263 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:15.241946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:15.242750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:15.243492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 67/134] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:15.248948 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd125c-cde3-4ee3-aff3-8deccd9a9382 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:15.331742 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:15.347681 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd125c-cde3-4ee3-aff3-8deccd9a9382 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:15.383131 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:15.383734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.384020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.384299 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.385003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:15.385313 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:15.386695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:15.394611 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 68/135] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:15.400248 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:15.445572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:15.459115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:15.500545 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1d2e-f34d-4125-9ebd-8ae64b82fc9c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:15.533190 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:15.533808 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.534091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.534363 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] PATH_INFO: `/v3/users/7d0242a63a364ccfae6e6cd1603e51d0` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.535476 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] RBAC: Authorizing `identity:get_user(user_id=7d0242a63a364ccfae6e6cd1603e51d0)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:15.537185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:15.538752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 68/136] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:15 2022] GET /identity/v3/users/7d0242a63a364ccfae6e6cd1603e51d0 => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:15.544187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:15.546779 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe67c4-e8a9-4490-a9a1-0910e78e1a06 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:15.579929 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:15.580548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.580828 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.581127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.582217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:15.583637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:15.585207 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 69/137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:15.590499 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:15.606814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:15.643089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cfe87-679b-47de-be7c-3c229fc60ebc None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:15.668254 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:15.679968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:15.680588 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.680905 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.681191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.693534 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8fbcc-5337-4aca-b3f3-44832c08155c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:15.726972 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:15.727512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:15.727796 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:15.728072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:15.728719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:15.730180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:15.749118 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:15.750849 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:15.752257 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 70/138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:15 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:23:15.859523 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 00:23:15.865429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:15.940160 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:15.973614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b53c8-9d7d-469c-84eb-75b663f9f870 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:16.006456 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9c8f1-3216-4736-a0dc-b78123e71a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:16.007015 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c8f1-3216-4736-a0dc-b78123e71a93 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:16.007297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c8f1-3216-4736-a0dc-b78123e71a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:16.007581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c8f1-3216-4736-a0dc-b78123e71a93 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:16.008685 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9c8f1-3216-4736-a0dc-b78123e71a93 None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:16.010149 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9c8f1-3216-4736-a0dc-b78123e71a93 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:16.011773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 71/140] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:15 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:16.018787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:16.048363 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:16.125291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c1e2-3c1c-4343-a0bf-21baafb01749 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:16.162939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17581fb8-21a1-4c1d-88d3-58d8817e59d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:16.163561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17581fb8-21a1-4c1d-88d3-58d8817e59d9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:16.163851 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17581fb8-21a1-4c1d-88d3-58d8817e59d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:16.164131 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17581fb8-21a1-4c1d-88d3-58d8817e59d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:16.164896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17581fb8-21a1-4c1d-88d3-58d8817e59d9 None admin] RBAC: Adding query filter params (role.id=88d42d2fdec94576b571dd7a1624a685, scope.project.id=393fe81231a348e7b30284cd804f160e, user.id=7d0242a63a364ccfae6e6cd1603e51d0) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:16.165221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17581fb8-21a1-4c1d-88d3-58d8817e59d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:16.166695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17581fb8-21a1-4c1d-88d3-58d8817e59d9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:16.173653 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 70/141] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:16 2022] GET /identity/v3/role_assignments?user.id=7d0242a63a364ccfae6e6cd1603e51d0&scope.project.id=393fe81231a348e7b30284cd804f160e&role.id=88d42d2fdec94576b571dd7a1624a685 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:18.064134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dd09-4f74-4ab3-bb4a-5f7c77bc4ad9 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.064679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dd09-4f74-4ab3-bb4a-5f7c77bc4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.064679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dd09-4f74-4ab3-bb4a-5f7c77bc4ad9 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.066133 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 72/142] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:18.072055 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500114c-649d-4042-b9d2-4cb188791a5b None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.072558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500114c-649d-4042-b9d2-4cb188791a5b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.072636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500114c-649d-4042-b9d2-4cb188791a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.090922 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-e500114c-649d-4042-b9d2-4cb188791a5b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:18.092364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e500114c-649d-4042-b9d2-4cb188791a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:18.161765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7c08-f973-4aeb-b145-ee8fd7e0fcaa None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.162067 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7c08-f973-4aeb-b145-ee8fd7e0fcaa None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.162532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b7c08-f973-4aeb-b145-ee8fd7e0fcaa None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.163865 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 73/143] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:18.168702 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da685e8a-5612-4353-b083-dc33596ba485 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.169041 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da685e8a-5612-4353-b083-dc33596ba485 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.169319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da685e8a-5612-4353-b083-dc33596ba485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.169419 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 71/144] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:18.187990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-da685e8a-5612-4353-b083-dc33596ba485 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:18.189135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-da685e8a-5612-4353-b083-dc33596ba485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:18.237894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26accf07-32b9-4a03-8f4e-16a2c4702cbd None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.238204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26accf07-32b9-4a03-8f4e-16a2c4702cbd None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.238466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26accf07-32b9-4a03-8f4e-16a2c4702cbd None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.239943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 72/145] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:18.244572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5665-41ac-4a18-b049-8d3261c00422 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.244883 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5665-41ac-4a18-b049-8d3261c00422 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.245165 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5665-41ac-4a18-b049-8d3261c00422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.256814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 74/146] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:18.264071 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-62ff5665-41ac-4a18-b049-8d3261c00422 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:18.265331 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-62ff5665-41ac-4a18-b049-8d3261c00422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:18.279973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:18.334146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:18.443703 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da685e8a-5612-4353-b083-dc33596ba485 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:18.511629 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:18.524606 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5665-41ac-4a18-b049-8d3261c00422 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:18.552248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da685e8a-5612-4353-b083-dc33596ba485 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:18.597818 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:18.598482 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.598760 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.599029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.610318 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:18.615071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:18.615973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:18.616913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 75/148] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:23:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:18.618189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:18.640261 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5665-41ac-4a18-b049-8d3261c00422 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:18.674341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:18.674973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.675258 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.675532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.685667 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:18.691054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:18.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 74/149] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:18.697877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:18.705537 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:18.721175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8470b1-1a5b-4f12-878d-1a332cd1e907 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:18.747624 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:18.755578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:18.756198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.756474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.756744 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.757881 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:18.759316 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:18.760977 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 76/150] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:18.761630 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:18.799868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9502e30-3ab2-4ce0-ab94-0ed4ad3898b5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:18.833339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:18.833936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.834213 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.834485 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.835185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:18.835488 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:18.836990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:18.845274 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:18.846037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:18.866135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5219-b3e8-4f3c-9ec9-9a6b88ea9205 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:18.900483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:18.901187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.901472 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.901746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.902403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:18.902705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:18.904058 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:18.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:18.913136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:18.918528 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:18.950761 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7854965-5164-426f-8dbe-5a64039ce290 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:18.974065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:18.985648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:18.986257 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:18.986541 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:18.986831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:18.987478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:18.988960 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:19.016345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 76/153] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:18 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:19.017195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66108ea-1686-4b75-aa11-0c3f01a0159b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:19.017332 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:19.058085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:19.059185 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:19.059743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:19.060030 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] PATH_INFO: `/v3/users/5758f8307cb54184a0b4c4a9ffd12324` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:19.077677 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] RBAC: Authorizing `identity:get_user(user_id=5758f8307cb54184a0b4c4a9ffd12324)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:19.079172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:19.085588 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 78/154] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:18 2022] GET /identity/v3/users/5758f8307cb54184a0b4c4a9ffd12324 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:19.086550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:19.145101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efffb5-033a-43d6-8acd-c9f33fce7d31 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:19.174688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:19.183605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:19.184247 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:19.184520 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:19.184791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] PATH_INFO: `/v3/users/5758f8307cb54184a0b4c4a9ffd12324` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:19.187329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] RBAC: Authorizing `identity:get_user(user_id=5758f8307cb54184a0b4c4a9ffd12324)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:19.188952 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:19.190556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 77/155] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:19 2022] GET /identity/v3/users/5758f8307cb54184a0b4c4a9ffd12324 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:19.196388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:19.202790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764c3e-3b89-43e7-8be7-1056790979e9 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:19.223453 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:19.248292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:19.249139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:19.249417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:19.249692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:19.251306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:19.252787 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:19.254506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 79/156] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:19 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:19.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:19.322808 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ebf3a-7001-42ba-8cb1-a57e569decc7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:19.364289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:19.364956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:19.365238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:19.365507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:19.366740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:19.368184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:19.370081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 78/157] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:19 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:19.377278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:19.392729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5df8b7-9a64-4978-a59b-281b9305f43f None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:19.431162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61055774-c438-4ad2-9c45-f16099a76701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:19.431883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61055774-c438-4ad2-9c45-f16099a76701 None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:19.432104 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61055774-c438-4ad2-9c45-f16099a76701 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:19.432501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61055774-c438-4ad2-9c45-f16099a76701 None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/5758f8307cb54184a0b4c4a9ffd12324/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:19.434568 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61055774-c438-4ad2-9c45-f16099a76701 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf60a1a3164d17bdd51d5818fe6856, user_id=5758f8307cb54184a0b4c4a9ffd12324, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:19.436044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61055774-c438-4ad2-9c45-f16099a76701 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:19.451119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:19 2022] PUT /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/5758f8307cb54184a0b4c4a9ffd12324/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:23:19.455372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:19.502957 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4523e4e-4541-4f36-83f0-748822124d93 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:19.543105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bb41b-1b21-401f-8b2e-be1a2774dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:19.544159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bb41b-1b21-401f-8b2e-be1a2774dae5 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:19.544641 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bb41b-1b21-401f-8b2e-be1a2774dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:19.545154 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bb41b-1b21-401f-8b2e-be1a2774dae5 None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/5758f8307cb54184a0b4c4a9ffd12324/roles/f411ad648adf4ef4bb52b64d0f648fff` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:19.547849 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bb41b-1b21-401f-8b2e-be1a2774dae5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf60a1a3164d17bdd51d5818fe6856, user_id=5758f8307cb54184a0b4c4a9ffd12324, role_id=f411ad648adf4ef4bb52b64d0f648fff)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:19.549709 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bb41b-1b21-401f-8b2e-be1a2774dae5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:19.569187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:19 2022] PUT /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/5758f8307cb54184a0b4c4a9ffd12324/roles/f411ad648adf4ef4bb52b64d0f648fff => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:23:21.315957 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c17e8-59a1-45ac-b1ee-03adb863fb58 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.316488 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c17e8-59a1-45ac-b1ee-03adb863fb58 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.316488 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c17e8-59a1-45ac-b1ee-03adb863fb58 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.318173 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 81/160] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:21.323853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a779a-9ac4-4c45-b3aa-7cc47b51a97f None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.324399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a779a-9ac4-4c45-b3aa-7cc47b51a97f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.324399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a779a-9ac4-4c45-b3aa-7cc47b51a97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.346033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-756a779a-9ac4-4c45-b3aa-7cc47b51a97f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:21.347616 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-756a779a-9ac4-4c45-b3aa-7cc47b51a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:21.420249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 80/161] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:21.450835 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8519d-871f-4203-b905-1a6e3048b3c8 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.451127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8519d-871f-4203-b905-1a6e3048b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.451382 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8519d-871f-4203-b905-1a6e3048b3c8 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.453452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 82/162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:21.458447 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1209829-7a17-4815-9285-7ebe6a165b63 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.458734 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1209829-7a17-4815-9285-7ebe6a165b63 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.459012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1209829-7a17-4815-9285-7ebe6a165b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.477435 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-d1209829-7a17-4815-9285-7ebe6a165b63 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:21.478656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d1209829-7a17-4815-9285-7ebe6a165b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:21.531195 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:21.557057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 81/163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:21.668692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018272f2-2047-4663-8fd5-8a9dd123681e None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.669025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018272f2-2047-4663-8fd5-8a9dd123681e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.669216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018272f2-2047-4663-8fd5-8a9dd123681e None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.670586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 83/164] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:21.677161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5cd74-b17c-4104-b18d-ae095ef3ad08 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.677616 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5cd74-b17c-4104-b18d-ae095ef3ad08 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.678000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5cd74-b17c-4104-b18d-ae095ef3ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.698368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-81c5cd74-b17c-4104-b18d-ae095ef3ad08 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:21.699591 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-81c5cd74-b17c-4104-b18d-ae095ef3ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:21.726261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018272f2-2047-4663-8fd5-8a9dd123681e None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:21.773199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:21.783102 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:21.789639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226396a-debb-4833-a893-0b2adfd74d62 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.789921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226396a-debb-4833-a893-0b2adfd74d62 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.790194 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226396a-debb-4833-a893-0b2adfd74d62 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.791701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 83/166] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:21.797439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17b9e8-6c26-4441-ac7e-1ba96b98f8ea None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.797721 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17b9e8-6c26-4441-ac7e-1ba96b98f8ea None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.797992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17b9e8-6c26-4441-ac7e-1ba96b98f8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.816413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-de17b9e8-6c26-4441-ac7e-1ba96b98f8ea None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:21.817637 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-de17b9e8-6c26-4441-ac7e-1ba96b98f8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:21.852308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018272f2-2047-4663-8fd5-8a9dd123681e None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:21.892886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:21.893514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:21.897086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 84/167] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:21.897210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:21.897210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:21.897354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17b9e8-6c26-4441-ac7e-1ba96b98f8ea None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:21.916020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:21.922861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:21.923705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:21.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 84/168] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:21.929871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:21.951755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.010414 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17b9e8-6c26-4441-ac7e-1ba96b98f8ea None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.055095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.055735 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.055925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4358c-8df3-4449-9921-b096c4e0ce08 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.056046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.056271 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.057408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.059051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.059470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.060816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 85/169] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:22.061408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.099492 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.100108 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.100396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.100675 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.101380 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:22.101688 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.103504 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.112864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 85/170] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:22.112864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.169204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aebc01-a181-4e5f-89ed-49f5b34e87dc None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.182701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.204278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.204954 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.205237 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.205511 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.215382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:22.221187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:22.222035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:22.222790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:22.223384 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b206-6ee4-4fd0-ad64-a914a3a560f0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.223460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 86/171] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:22.223460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.257337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.257937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.258214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.258485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.259127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.260553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.282033 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 86/172] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:22 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:22.282740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.309887 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.344437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5897c68-94f5-4e5b-a502-45e3a00d88c2 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.384408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.385079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.385353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.385622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] PATH_INFO: `/v3/users/a042b22c594c41188d97d93906bab216` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.400293 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ec890-3415-4edd-a8c8-5e346c756a6d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.401671 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] RBAC: Authorizing `identity:get_user(user_id=a042b22c594c41188d97d93906bab216)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.403170 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.405156 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 87/173] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/users/a042b22c594c41188d97d93906bab216 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:22.405822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.439047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.439651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.439916 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.440193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.445298 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.452850 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:22.458267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:22.459708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:22.461678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 87/174] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:22.465256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.533265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1dd90-f6ed-4be8-87ce-cbc159755be1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.571755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.575695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.576321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.576638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.576912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.578246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:22.578547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.579932 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.591101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:22.591776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.597717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae091d7-8899-438e-8091-ad06327d0511 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.647019 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.648252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.648538 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.649158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.650453 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.651925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.653927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:22.654706 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.702027 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.712545 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f817-c3bc-43dd-9c0f-1cd9e71a1036 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.754310 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.755037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.755408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.755784 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.756551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:22.756979 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.758456 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.774068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:22.775517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.794161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e863d-b26a-4caf-8350-8006868a1bb3 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.841630 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.843329 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.843870 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.844577 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] PATH_INFO: `/v3/users/5758f8307cb54184a0b4c4a9ffd12324` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.846653 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] RBAC: Authorizing `identity:get_user(user_id=5758f8307cb54184a0b4c4a9ffd12324)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.848953 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.851000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 89/178] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/users/5758f8307cb54184a0b4c4a9ffd12324 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:22.856368 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.882341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.895015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb456e9-3cac-4e4d-99a5-f0a5bd5bbd31 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:22.938122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:22.939003 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:22.939377 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:22.939833 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/a042b22c594c41188d97d93906bab216/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:22.941957 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf60a1a3164d17bdd51d5818fe6856, user_id=a042b22c594c41188d97d93906bab216, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:22.943714 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:22.958746 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:22 2022] PUT /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/a042b22c594c41188d97d93906bab216/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:22.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:22.984062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:22.999641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8d13-0a88-4904-99be-eb7cc3f51a4e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:23.055276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:23.055875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:23.056153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:23.056425 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] PATH_INFO: `/v3/users/5758f8307cb54184a0b4c4a9ffd12324` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:23.059153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] RBAC: Authorizing `identity:get_user(user_id=5758f8307cb54184a0b4c4a9ffd12324)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:23.060614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:23.064086 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 90/180] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/users/5758f8307cb54184a0b4c4a9ffd12324 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:23.069530 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:23.144535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed51c37-c20e-4666-96a2-aff390232d0d None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:23.195111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:23.195737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:23.196018 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:23.196292 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:23.216107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:23.237409 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612882a-cae6-4dac-85e0-8012eb19e20d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:23.277000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:23.277718 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:23.278001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:23.278272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:23.329734 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:23.331266 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:23.348518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:23.370363 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:23.371955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:23.492200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:23.498978 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:23.530541 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:23.560093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:23.566009 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:23.695680 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6b44-f48e-4125-9d2a-13a5104c7882 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:23.717659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c093-dee1-40bc-b733-67d925384a0f None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:23.741962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:23.754622 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:23.755183 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:23.755462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:23.755733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:23.756877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:23.758450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:23.760069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 92/183] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:23 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:23.766446 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:23.813575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:23.814233 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:23.814517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:23.814794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:23.815969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:23.817454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:23.824075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 92/184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:23 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:23.824962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:23.825164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:23.918411 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb3061-16a6-4241-9e21-783958ac808b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:23.983348 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3245-c0fa-4a67-b214-b79b25d78018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:23.984479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3245-c0fa-4a67-b214-b79b25d78018 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:23.984758 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3245-c0fa-4a67-b214-b79b25d78018 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:23.985052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3245-c0fa-4a67-b214-b79b25d78018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:23.985776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3245-c0fa-4a67-b214-b79b25d78018 None admin] RBAC: Adding query filter params (role.id=f411ad648adf4ef4bb52b64d0f648fff, scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856, user.id=5758f8307cb54184a0b4c4a9ffd12324) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:23.986081 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3245-c0fa-4a67-b214-b79b25d78018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:23.990601 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3245-c0fa-4a67-b214-b79b25d78018 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:24.002311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 93/185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:23 2022] GET /identity/v3/role_assignments?user.id=5758f8307cb54184a0b4c4a9ffd12324&scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856&role.id=f411ad648adf4ef4bb52b64d0f648fff => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:24.024064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac320-c9ff-4bcd-b48f-ab61c3eec185 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:24.082511 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a6aa8-1396-481f-9546-3fabb0dda072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:24.083123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a6aa8-1396-481f-9546-3fabb0dda072 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:24.083400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a6aa8-1396-481f-9546-3fabb0dda072 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:24.083668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a6aa8-1396-481f-9546-3fabb0dda072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:24.084403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a6aa8-1396-481f-9546-3fabb0dda072 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856, user.id=5758f8307cb54184a0b4c4a9ffd12324) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:24.084709 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a6aa8-1396-481f-9546-3fabb0dda072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:24.086273 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a6aa8-1396-481f-9546-3fabb0dda072 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:24.092902 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 93/186] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:23 2022] GET /identity/v3/role_assignments?user.id=5758f8307cb54184a0b4c4a9ffd12324&scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:24.752162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82081-871f-45de-8cdc-bb2afe613fdb None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:24.752675 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82081-871f-45de-8cdc-bb2afe613fdb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:24.752776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82081-871f-45de-8cdc-bb2afe613fdb None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:24.754222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 94/187] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:24.759228 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e4aa-03d1-4e48-8edf-865537562ae2 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:24.759614 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e4aa-03d1-4e48-8edf-865537562ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:24.759789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e4aa-03d1-4e48-8edf-865537562ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:24.778887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-58e8e4aa-03d1-4e48-8edf-865537562ae2 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:24.780111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-58e8e4aa-03d1-4e48-8edf-865537562ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:24.822776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:24.849159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 94/188] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:24.985189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a441f2-8e0e-41b3-bd2b-f4f9b40dfde2 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:24.985501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a441f2-8e0e-41b3-bd2b-f4f9b40dfde2 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:24.985744 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a441f2-8e0e-41b3-bd2b-f4f9b40dfde2 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:24.987220 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 95/189] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:24.992251 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e938f-b5ed-4b2f-8b47-4b106dfdae74 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:24.992545 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e938f-b5ed-4b2f-8b47-4b106dfdae74 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:24.992822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e938f-b5ed-4b2f-8b47-4b106dfdae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.011563 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-d65e938f-b5ed-4b2f-8b47-4b106dfdae74 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:25.012665 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d65e938f-b5ed-4b2f-8b47-4b106dfdae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:25.079355 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 95/190] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:25.121314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a441f2-8e0e-41b3-bd2b-f4f9b40dfde2 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.225084 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a441f2-8e0e-41b3-bd2b-f4f9b40dfde2 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.245466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:25.263710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88ba7d-5d68-48d3-9986-1e5135a5e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.264261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88ba7d-5d68-48d3-9986-1e5135a5e25d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.265090 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88ba7d-5d68-48d3-9986-1e5135a5e25d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.265364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88ba7d-5d68-48d3-9986-1e5135a5e25d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.275566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88ba7d-5d68-48d3-9986-1e5135a5e25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-0c88ba7d-5d68-48d3-9986-1e5135a5e25d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:25.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:25.281528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:25.282437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 96/191] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:25.287654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e938f-b5ed-4b2f-8b47-4b106dfdae74 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.339599 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacee05-d022-4737-a925-d7ea677d0cf0 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.339886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacee05-d022-4737-a925-d7ea677d0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.340150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacee05-d022-4737-a925-d7ea677d0cf0 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.341516 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 97/192] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:25.346750 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2f91-bb19-4158-9c72-7e053fe6a83b None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.347034 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2f91-bb19-4158-9c72-7e053fe6a83b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.347309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2f91-bb19-4158-9c72-7e053fe6a83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.366195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-8cee2f91-bb19-4158-9c72-7e053fe6a83b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:25.367407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-8cee2f91-bb19-4158-9c72-7e053fe6a83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:25.387941 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e938f-b5ed-4b2f-8b47-4b106dfdae74 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.395284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:25.423732 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.424343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.424623 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.424928 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.425597 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:25.425903 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:25.427286 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:25.435518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 98/193] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:25.441009 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2f91-bb19-4158-9c72-7e053fe6a83b None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.441088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:25.442352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.543996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2f91-bb19-4158-9c72-7e053fe6a83b None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.553643 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:25.558508 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e3f2-b384-4b40-8b3d-247e4f7a237c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.585897 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.586429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.586716 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.587404 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.588737 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:25.591095 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:25.593349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 99/195] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:25.598567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.598761 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.599339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.599886 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] PATH_INFO: `/v3/users/207965e1fae547a5b7be0de7967ebbb2` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.615512 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] RBAC: Authorizing `identity:get_user(user_id=207965e1fae547a5b7be0de7967ebbb2)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:25.617015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:25.618663 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 97/196] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:25 2022] GET /identity/v3/users/207965e1fae547a5b7be0de7967ebbb2 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:25.624427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.652747 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:25.709275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8931e-8833-402b-a550-215e7e1168ec None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.731201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f4d0-332f-4d8e-ade5-0cd449e892e1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.742858 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.743461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.743734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.744004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.744646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:25.746100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:25.765508 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.766138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.766413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.766683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.767068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 100/197] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:25 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:23:25.767880 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.768195 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:25.769585 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:25.771263 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 98/198] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:25 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:25.783413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:25.813350 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:25.894321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:25.899076 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542c66-7874-4854-ae78-51405b6df2f9 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.902832 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40532e3d-bc7f-40f4-bfaa-f0a07541bd0c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:25.944807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.945032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:25.945309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.945573 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:25.945671 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.945840 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/207965e1fae547a5b7be0de7967ebbb2/roles/88d42d2fdec94576b571dd7a1624a685` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.945930 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:25.946465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:25.947883 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf60a1a3164d17bdd51d5818fe6856, user_id=207965e1fae547a5b7be0de7967ebbb2, role_id=88d42d2fdec94576b571dd7a1624a685)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:25.949449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:25.961087 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:25.963897 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 99/199] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:25 2022] PUT /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/users/207965e1fae547a5b7be0de7967ebbb2/roles/88d42d2fdec94576b571dd7a1624a685 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:25.966060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:25.966952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:25.968586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 101/200] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:25.973761 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:26.097044 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ff4b-9a8e-41d4-8ba9-92a84e1d7fc7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:26.136043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:26.136676 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:26.136990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:26.137268 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:26.137948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] RBAC: Adding query filter params (name=member) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:26.138257 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:26.140302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:26.149445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 100/201] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:26.155222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:26.249297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:26.262588 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f097-4e44-483b-945b-e8a22208bbc9 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:26.299442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498d924-903d-446d-bf27-367a310333ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:26.300074 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d924-903d-446d-bf27-367a310333ba None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:26.300361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d924-903d-446d-bf27-367a310333ba None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:26.300634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d924-903d-446d-bf27-367a310333ba None admin] PATH_INFO: `/v3/users/a042b22c594c41188d97d93906bab216` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:26.301816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498d924-903d-446d-bf27-367a310333ba None admin] RBAC: Authorizing `identity:get_user(user_id=a042b22c594c41188d97d93906bab216)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:26.303274 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498d924-903d-446d-bf27-367a310333ba None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:26.305059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 102/202] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:26 2022] GET /identity/v3/users/a042b22c594c41188d97d93906bab216 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:26.310487 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:26.332519 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:26.427823 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd87198-26d2-4d47-a8e2-4b303e8a3518 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:26.464141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:26.465184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:26.465683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:26.466166 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:26.536921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:26.538698 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:26.555910 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:26.644784 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 101/203] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:26.650392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498d924-903d-446d-bf27-367a310333ba None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:26.753098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498d924-903d-446d-bf27-367a310333ba None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:26.787423 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1658d2-2879-41a1-b7c0-b4a393e46cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:26.788168 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1658d2-2879-41a1-b7c0-b4a393e46cab None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:26.788380 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1658d2-2879-41a1-b7c0-b4a393e46cab None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:26.788636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1658d2-2879-41a1-b7c0-b4a393e46cab None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:26.789874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1658d2-2879-41a1-b7c0-b4a393e46cab None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:26.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1658d2-2879-41a1-b7c0-b4a393e46cab None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:26.792941 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:26 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:26.799457 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:26.907605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796ff49-fd52-4d8b-8393-a7d376d45456 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:26.937400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:26.953778 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6d71d-17e6-4329-bda2-2045c6b5eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:26.954384 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6d71d-17e6-4329-bda2-2045c6b5eb4f None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:26.954659 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6d71d-17e6-4329-bda2-2045c6b5eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:26.954930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6d71d-17e6-4329-bda2-2045c6b5eb4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:26.955658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6d71d-17e6-4329-bda2-2045c6b5eb4f None admin] RBAC: Adding query filter params (role.id=c1be01f06d6d4babaadc2a4809ef9dfc, scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856, user.id=a042b22c594c41188d97d93906bab216) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:26.955964 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6d71d-17e6-4329-bda2-2045c6b5eb4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:26.957423 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6d71d-17e6-4329-bda2-2045c6b5eb4f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:26.963456 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:26 2022] GET /identity/v3/role_assignments?user.id=a042b22c594c41188d97d93906bab216&scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856&role.id=c1be01f06d6d4babaadc2a4809ef9dfc => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:28.159685 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051d61-4de4-475e-b13e-3070f9c06338 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.160198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051d61-4de4-475e-b13e-3070f9c06338 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.160198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051d61-4de4-475e-b13e-3070f9c06338 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.161993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 104/206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:28.166948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71f79-a162-4942-83bd-ac043292049f None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.167316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71f79-a162-4942-83bd-ac043292049f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.167494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71f79-a162-4942-83bd-ac043292049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.186912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-0cb71f79-a162-4942-83bd-ac043292049f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:28.188159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-0cb71f79-a162-4942-83bd-ac043292049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:28.205499 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc0901-1e70-434e-a544-983d6499a123 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.205780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc0901-1e70-434e-a544-983d6499a123 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.206045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc0901-1e70-434e-a544-983d6499a123 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.207371 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 105/207] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:28.212539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944fd7a-95f9-4d41-a3fe-a1767da5359f None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.212824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944fd7a-95f9-4d41-a3fe-a1767da5359f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.213127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944fd7a-95f9-4d41-a3fe-a1767da5359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.232307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3944fd7a-95f9-4d41-a3fe-a1767da5359f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:28.234153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3944fd7a-95f9-4d41-a3fe-a1767da5359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:28.257138 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:28.262939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 103/208] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:28.264262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0653-a568-4029-b59b-b9f335bbe510 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.264562 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0653-a568-4029-b59b-b9f335bbe510 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.264859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0653-a568-4029-b59b-b9f335bbe510 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.266277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:28.271307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1577f4-a0c3-4d68-8e10-5c46678da5ad None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.271595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1577f4-a0c3-4d68-8e10-5c46678da5ad None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.271871 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1577f4-a0c3-4d68-8e10-5c46678da5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.292592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-8c1577f4-a0c3-4d68-8e10-5c46678da5ad None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:28.293956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8c1577f4-a0c3-4d68-8e10-5c46678da5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:28.307817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 106/210] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:28.363142 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:28.532288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944fd7a-95f9-4d41-a3fe-a1767da5359f None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:28.581291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1577f4-a0c3-4d68-8e10-5c46678da5ad None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:28.624172 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:28.637735 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944fd7a-95f9-4d41-a3fe-a1767da5359f None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:28.674444 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:28.675258 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.675543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.675812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.683924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1577f4-a0c3-4d68-8e10-5c46678da5ad None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:28.686805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:28.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:28.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:28.693295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 107/212] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:28.694770 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:28.714039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:28.719869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:28.720509 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.720788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.721090 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.722183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:28.723622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:28.725249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 106/213] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:28.726002 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:28.799361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc83d2-44e3-46ae-95eb-46e5981e031e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:28.824673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe22b2-7bd9-4b9e-bd77-061ae22667cd None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:28.833068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:28.833687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.833881 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:28.833978 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.834217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.844316 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:28.849025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:28.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:28.850698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 108/214] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:28.851339 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:28.863001 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:28.863615 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.863894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.864168 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.864843 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:28.865161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:28.866538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:28.874707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 107/215] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:28.875486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:28.935958 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:28.959121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b360c-925d-4d79-8cbf-a8c96ebb1ee3 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:28.975277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568459a-73d5-4643-bf9f-e6d0ce201e8a None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:28.992219 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:28.992820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:28.993128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:28.993399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:28.994046 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:28.995472 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.006816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:29.007416 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:29.007746 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:29.008022 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:29.008787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:29.009117 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:29.010603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.027331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 109/216] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:28 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:29.027331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:29.027587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 108/217] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:29.027587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:29.063532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:29.144019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4269f2-8ae7-4526-be2d-997a60bdee40 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:29.150944 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f72a8-8230-4f6f-a0dd-ebdcd8f287fa None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:29.180849 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:29.181606 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:29.181897 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:29.182177 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] PATH_INFO: `/v3/users/207965e1fae547a5b7be0de7967ebbb2` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:29.183329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] RBAC: Authorizing `identity:get_user(user_id=207965e1fae547a5b7be0de7967ebbb2)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:29.184783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.187313 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 109/218] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:29 2022] GET /identity/v3/users/207965e1fae547a5b7be0de7967ebbb2 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:29.190184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:29.191548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:29.191548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:29.191548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] PATH_INFO: `/v3/users/9ba6fba20833444d80618b7ae786992a` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:29.192860 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:29.193866 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:29.208505 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] RBAC: Authorizing `identity:get_user(user_id=9ba6fba20833444d80618b7ae786992a)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:29.210314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.212266 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 110/219] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:29 2022] GET /identity/v3/users/9ba6fba20833444d80618b7ae786992a => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:29.219005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:29.309119 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:29.312621 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3a81-ec79-4c5b-b9ae-85b356d031ba None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:29.349542 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ec61-f980-40e4-a36d-4656495300c5 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:29.361657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:29.362431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:29.362710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:29.362980 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:29.396016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:29.396638 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:29.397645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:29.397645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:29.397967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] RBAC: Adding query filter params (role.id=c1be01f06d6d4babaadc2a4809ef9dfc, user.id=9ba6fba20833444d80618b7ae786992a, scope.system=all) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:29.398264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:29.399714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.405736 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 111/220] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 00:23:29 2022] GET /identity/v3/role_assignments?user.id=9ba6fba20833444d80618b7ae786992a&scope.system=all&role.id=c1be01f06d6d4babaadc2a4809ef9dfc => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:29.447129 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:29.448620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.564109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:29.568621 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 110/221] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:29.577494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:29.637612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:29.685393 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931bfee-2dba-452e-a70f-0861b4ddb2e5 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:29.723069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff8ed0-4808-4f61-9c9b-a4ea8db318da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:29.723941 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff8ed0-4808-4f61-9c9b-a4ea8db318da None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:29.724359 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff8ed0-4808-4f61-9c9b-a4ea8db318da None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:29.724770 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff8ed0-4808-4f61-9c9b-a4ea8db318da None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:29.726083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff8ed0-4808-4f61-9c9b-a4ea8db318da None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:29.727653 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff8ed0-4808-4f61-9c9b-a4ea8db318da None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.729804 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 112/222] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:29 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:29.735848 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:29.844932 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6778a-5e0b-4575-9e85-d90cb54a2ae4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:29.881032 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878416a-47c5-48cc-8b10-d3a6705d4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:29.881654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878416a-47c5-48cc-8b10-d3a6705d4ece None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:29.881935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878416a-47c5-48cc-8b10-d3a6705d4ece None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:29.882210 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878416a-47c5-48cc-8b10-d3a6705d4ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:29.882952 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878416a-47c5-48cc-8b10-d3a6705d4ece None admin] RBAC: Adding query filter params (role.id=88d42d2fdec94576b571dd7a1624a685, scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856, user.id=207965e1fae547a5b7be0de7967ebbb2) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:29.883267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878416a-47c5-48cc-8b10-d3a6705d4ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:29.884800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878416a-47c5-48cc-8b10-d3a6705d4ece None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:29.891536 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 111/223] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:23:29 2022] GET /identity/v3/role_assignments?user.id=207965e1fae547a5b7be0de7967ebbb2&scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856&role.id=88d42d2fdec94576b571dd7a1624a685 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:31.460867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725d846-92a3-4683-84a8-1a133c337b63 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:31.460867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725d846-92a3-4683-84a8-1a133c337b63 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:31.460867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725d846-92a3-4683-84a8-1a133c337b63 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:31.461526 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 113/224] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:31.465506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db789c-2d9c-480c-b282-75e369ebed51 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:31.465929 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db789c-2d9c-480c-b282-75e369ebed51 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:31.466126 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db789c-2d9c-480c-b282-75e369ebed51 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:31.466489 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b12c85-104a-4c6d-93c5-adda17919246 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:31.466776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b12c85-104a-4c6d-93c5-adda17919246 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:31.467055 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b12c85-104a-4c6d-93c5-adda17919246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:31.467707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 112/225] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:31.472656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bad28-eaf8-4edd-aa09-577d4ec51192 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:31.472977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bad28-eaf8-4edd-aa09-577d4ec51192 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:31.473421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bad28-eaf8-4edd-aa09-577d4ec51192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:31.488943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-d3b12c85-104a-4c6d-93c5-adda17919246 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:31.490136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-d3b12c85-104a-4c6d-93c5-adda17919246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:31.492038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4e7bad28-eaf8-4edd-aa09-577d4ec51192 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:31.494141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4e7bad28-eaf8-4edd-aa09-577d4ec51192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:31.565207 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:31.573353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 114/226] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:31.574449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 113/227] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:31.615695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d336d-560a-4457-97b5-5ebf1e368eef None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:31.615987 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d336d-560a-4457-97b5-5ebf1e368eef None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:31.616253 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d336d-560a-4457-97b5-5ebf1e368eef None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:31.617753 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 115/228] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:31.622602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbce31-5c0e-4527-a618-6d6826d61dff None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:31.622888 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbce31-5c0e-4527-a618-6d6826d61dff None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:31.623165 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbce31-5c0e-4527-a618-6d6826d61dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:31.641137 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-afcbce31-5c0e-4527-a618-6d6826d61dff None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:31.642308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-afcbce31-5c0e-4527-a618-6d6826d61dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:31.709370 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 114/229] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:31.840869 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d336d-560a-4457-97b5-5ebf1e368eef None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:31.850409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbce31-5c0e-4527-a618-6d6826d61dff None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:31.909343 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:31.960044 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbce31-5c0e-4527-a618-6d6826d61dff None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:31.963924 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d336d-560a-4457-97b5-5ebf1e368eef None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:31.988412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:31.999797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154698-3712-496a-9047-7f3e73526338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.000012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.000413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154698-3712-496a-9047-7f3e73526338 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.000645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.000757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154698-3712-496a-9047-7f3e73526338 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.000955 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154698-3712-496a-9047-7f3e73526338 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.001231 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.002049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57154698-3712-496a-9047-7f3e73526338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.003466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57154698-3712-496a-9047-7f3e73526338 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.005043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 116/230] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:32.005802 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154698-3712-496a-9047-7f3e73526338 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.013918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:32.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:32.020019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:32.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 115/231] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:32.021956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.106314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154698-3712-496a-9047-7f3e73526338 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.121648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8df4-195b-4162-800d-195f206bf828 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.128896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:32.141059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.141684 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.141967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.142235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.152176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:32.154595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.155897 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.156189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.156465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] PATH_INFO: `/v3/groups` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.157159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:32.157940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:32.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:32.159575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:32.160316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.160381 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 117/232] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:32.160381 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.178215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 116/233] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 19 00:23:32 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:32.178834 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.231414 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:32.287875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bf485-5499-448f-9e34-47a4aad8f812 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.294685 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476355a-081f-404a-bbb8-c8be7015dc56 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.325312 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.326050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.326330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.326604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.327830 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:32.328134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.329575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.336076 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.337012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.337476 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.337924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.338748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] RBAC: Adding query filter params (name=member) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:32.338853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 118/234] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:32.339268 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.341002 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.344805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.352301 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 117/235] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:32.357542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.401301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:32.460818 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3da82-f37b-4648-afe2-3840f0a02676 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.464779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d401fe-dbce-4504-af5f-7faa9f0d8adb None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.472014 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:32.497757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.498376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.498789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.499065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] PATH_INFO: `/v3/users/aae422937ba34f5ca690c39766b67624` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.502965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.503788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.504240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.504682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] PATH_INFO: `/v3/users/9ba6fba20833444d80618b7ae786992a` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.505988 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] RBAC: Authorizing `identity:get_user(user_id=9ba6fba20833444d80618b7ae786992a)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.507714 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.509927 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 118/236] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:32 2022] GET /identity/v3/users/9ba6fba20833444d80618b7ae786992a => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:32.516047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.517113 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] RBAC: Authorizing `identity:get_user(user_id=aae422937ba34f5ca690c39766b67624)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.518568 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.520223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 119/237] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:32 2022] GET /identity/v3/users/aae422937ba34f5ca690c39766b67624 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:32.526325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:32.628480 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eacd5-da48-40b0-91a8-ff92f2074827 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.636136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ff2cd-47f7-4c1e-81b7-11388f27262b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:32.638161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:32.662069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e1bf-e1a9-4b0d-b4a0-6a829a5b07e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.662714 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e1bf-e1a9-4b0d-b4a0-6a829a5b07e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.662998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e1bf-e1a9-4b0d-b4a0-6a829a5b07e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.663269 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e1bf-e1a9-4b0d-b4a0-6a829a5b07e8 None admin] PATH_INFO: `/v3/system/users/9ba6fba20833444d80618b7ae786992a/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.664660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4e1bf-e1a9-4b0d-b4a0-6a829a5b07e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9ba6fba20833444d80618b7ae786992a, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.666062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4e1bf-e1a9-4b0d-b4a0-6a829a5b07e8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.675600 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 119/238] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 19 00:23:32 2022] PUT /identity/v3/system/users/9ba6fba20833444d80618b7ae786992a/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:23:32.677919 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed3cd-7c0a-4912-97d7-66fb0d260273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:32.678718 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed3cd-7c0a-4912-97d7-66fb0d260273 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:32.678991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed3cd-7c0a-4912-97d7-66fb0d260273 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:32.679261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed3cd-7c0a-4912-97d7-66fb0d260273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:32.680024 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed3cd-7c0a-4912-97d7-66fb0d260273 None admin] RBAC: Adding query filter params (role.id=88d42d2fdec94576b571dd7a1624a685, user.id=aae422937ba34f5ca690c39766b67624, scope.system=all) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:32.680397 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed3cd-7c0a-4912-97d7-66fb0d260273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:32.681832 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed3cd-7c0a-4912-97d7-66fb0d260273 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:32.688802 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 120/239] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 00:23:32 2022] GET /identity/v3/role_assignments?user.id=aae422937ba34f5ca690c39766b67624&scope.system=all&role.id=88d42d2fdec94576b571dd7a1624a685 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:34.377348 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06abac-905a-4556-872f-87993d75e5d5 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:34.377864 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06abac-905a-4556-872f-87993d75e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:34.377937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06abac-905a-4556-872f-87993d75e5d5 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:34.380876 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 120/240] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:34.384449 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b4194-7bed-4fef-bd5b-c7241d8ab3c9 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:34.384914 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b4194-7bed-4fef-bd5b-c7241d8ab3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:34.385152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b4194-7bed-4fef-bd5b-c7241d8ab3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:34.403586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-923b4194-7bed-4fef-bd5b-c7241d8ab3c9 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:34.404806 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-923b4194-7bed-4fef-bd5b-c7241d8ab3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:34.476872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 121/241] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:34.747623 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06abac-905a-4556-872f-87993d75e5d5 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:34.794521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:34.844188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eec285-f564-4411-ba96-0671282bce11 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:34.844505 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eec285-f564-4411-ba96-0671282bce11 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:34.844751 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eec285-f564-4411-ba96-0671282bce11 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:34.846950 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 122/242] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:34.852081 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0038-ee45-41ca-b1d1-cf91a01a077d None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:34.852451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0038-ee45-41ca-b1d1-cf91a01a077d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:34.853203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0038-ee45-41ca-b1d1-cf91a01a077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:34.859906 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06abac-905a-4556-872f-87993d75e5d5 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:34.872378 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-08be0038-ee45-41ca-b1d1-cf91a01a077d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:34.874278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-08be0038-ee45-41ca-b1d1-cf91a01a077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:34.894475 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbfbeb-fcfe-484b-ad53-3ced71003064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:34.895104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfbeb-fcfe-484b-ad53-3ced71003064 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:34.895386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfbeb-fcfe-484b-ad53-3ced71003064 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:34.895658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfbeb-fcfe-484b-ad53-3ced71003064 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:34.896745 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbfbeb-fcfe-484b-ad53-3ced71003064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:34.898252 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbfbeb-fcfe-484b-ad53-3ced71003064 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:34.900106 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 121/243] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:34.901242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b32c8-098e-49e0-8f39-b1151e7f9f7b None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:34.901522 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b32c8-098e-49e0-8f39-b1151e7f9f7b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:34.901794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b32c8-098e-49e0-8f39-b1151e7f9f7b None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:34.902993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 122/244] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:34.905115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b32c8-098e-49e0-8f39-b1151e7f9f7b None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:34.940652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 123/245] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:34.942460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945022-86a3-4d33-9e5e-1ff45077c845 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:34.942460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945022-86a3-4d33-9e5e-1ff45077c845 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:34.942460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945022-86a3-4d33-9e5e-1ff45077c845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:34.964003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-7b945022-86a3-4d33-9e5e-1ff45077c845 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:34.965219 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-7b945022-86a3-4d33-9e5e-1ff45077c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:34.986583 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:35.016550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b32c8-098e-49e0-8f39-b1151e7f9f7b None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.024507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:35.036764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 124/246] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:35.058563 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.059173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.059451 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.059720 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] PATH_INFO: `/v3/groups` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.060342 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:35.062386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:35.077781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 123/247] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 19 00:23:34 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:23:35.212561 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945022-86a3-4d33-9e5e-1ff45077c845 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.312423 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.320450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945022-86a3-4d33-9e5e-1ff45077c845 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.357740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.358706 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.358985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.359264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.374124 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:35.378955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:35.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:35.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 125/248] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:35.385833 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.410993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:35.434126 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7f75-472a-49ca-9aee-d47e7d3ddc08 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.473735 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.474370 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.474638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.474912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.491311 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:35.495793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:35.496638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:35.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 124/249] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:35.503398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.529939 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d8bd-4e8c-48c7-a439-5b2f1c2cc611 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.542849 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:35.576013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.577105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.577369 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.577730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.578496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] RBAC: Adding query filter params (name=member) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:35.578708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:35.580441 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:35.591034 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 126/250] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:35.596953 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.631698 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4466f-f592-4ee3-a8ad-94f1e64c16bd None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.669319 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.670231 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.671208 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.671664 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.672513 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:35.673057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:35.674633 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:35.684996 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 125/251] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:35.690888 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.702151 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:35.726579 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147519-41c3-43d1-9e6c-dce51ed41d7f None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.774457 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.775237 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.775672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.776014 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] PATH_INFO: `/v3/users/9ba6fba20833444d80618b7ae786992a` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.778038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] RBAC: Authorizing `identity:get_user(user_id=9ba6fba20833444d80618b7ae786992a)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:35.780425 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:35.782503 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 127/252] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:35 2022] GET /identity/v3/users/9ba6fba20833444d80618b7ae786992a => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:35.796377 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.809342 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:35.827941 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d1a1-025a-4fdd-ac24-609b320e813c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.876179 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.876815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.877193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.877408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] PATH_INFO: `/v3/users/aae422937ba34f5ca690c39766b67624` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.878555 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] RBAC: Authorizing `identity:get_user(user_id=aae422937ba34f5ca690c39766b67624)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:35.880020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:35.881663 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 126/253] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:35 2022] GET /identity/v3/users/aae422937ba34f5ca690c39766b67624 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:35.887738 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:35.942085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09eb7e-011c-41c0-a2eb-bae349f317ae None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:35.994629 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b312cd-12b7-428d-824a-cee796d5414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:35.995254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b312cd-12b7-428d-824a-cee796d5414a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:35.995535 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b312cd-12b7-428d-824a-cee796d5414a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:35.995812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b312cd-12b7-428d-824a-cee796d5414a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:35.996549 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b312cd-12b7-428d-824a-cee796d5414a None admin] RBAC: Adding query filter params (role.id=c1be01f06d6d4babaadc2a4809ef9dfc, user.id=9ba6fba20833444d80618b7ae786992a, scope.system=all) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:35.996879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b312cd-12b7-428d-824a-cee796d5414a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:35.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b312cd-12b7-428d-824a-cee796d5414a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:36.013555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 128/254] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 00:23:35 2022] GET /identity/v3/role_assignments?user.id=9ba6fba20833444d80618b7ae786992a&scope.system=all&role.id=c1be01f06d6d4babaadc2a4809ef9dfc => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:36.023247 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634e9ef-d81f-4e06-987e-c09b6fd9adc5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:36.078108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92482b50-acc8-4482-96cb-c428261ec7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:36.078705 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92482b50-acc8-4482-96cb-c428261ec7d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:36.078981 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92482b50-acc8-4482-96cb-c428261ec7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:36.079324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92482b50-acc8-4482-96cb-c428261ec7d7 None admin] PATH_INFO: `/v3/system/users/aae422937ba34f5ca690c39766b67624/roles/88d42d2fdec94576b571dd7a1624a685` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:36.080985 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92482b50-acc8-4482-96cb-c428261ec7d7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aae422937ba34f5ca690c39766b67624, role_id=88d42d2fdec94576b571dd7a1624a685)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:36.082430 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92482b50-acc8-4482-96cb-c428261ec7d7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:36.103773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 127/255] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 19 00:23:35 2022] PUT /identity/v3/system/users/aae422937ba34f5ca690c39766b67624/roles/88d42d2fdec94576b571dd7a1624a685 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:37.751184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f0daf-55ef-45cc-87cf-c37112e6f2bf None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:37.752018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f0daf-55ef-45cc-87cf-c37112e6f2bf None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:37.752461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f0daf-55ef-45cc-87cf-c37112e6f2bf None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:37.754250 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 129/256] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:37.767660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec061c-68a1-4f82-8203-b8c60a30cd85 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:37.768464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec061c-68a1-4f82-8203-b8c60a30cd85 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:37.768899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec061c-68a1-4f82-8203-b8c60a30cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:37.787086 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d75eb8-b38e-44e0-a293-1da4bc6ab72b None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:37.788241 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d75eb8-b38e-44e0-a293-1da4bc6ab72b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:37.788745 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d75eb8-b38e-44e0-a293-1da4bc6ab72b None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:37.790928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 130/257] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:37.795219 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-d4ec061c-68a1-4f82-8203-b8c60a30cd85 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:37.796177 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c2b7-9d34-4cce-ab4c-ebfb3f2ad7ec None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:37.796536 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d4ec061c-68a1-4f82-8203-b8c60a30cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:37.796944 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c2b7-9d34-4cce-ab4c-ebfb3f2ad7ec None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:37.797567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c2b7-9d34-4cce-ab4c-ebfb3f2ad7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:37.808340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:37.822320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:37.828266 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-cd10c2b7-9d34-4cce-ab4c-ebfb3f2ad7ec None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:37.829825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-cd10c2b7-9d34-4cce-ab4c-ebfb3f2ad7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:37.912861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 128/258] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 19 00:23:37.950181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 131/259] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 19 00:23:38.441788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec061c-68a1-4f82-8203-b8c60a30cd85 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.451309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec061c-68a1-4f82-8203-b8c60a30cd85 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.460745 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.461593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.462011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.462437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.475945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c2b7-9d34-4cce-ab4c-ebfb3f2ad7ec None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.491664 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c2b7-9d34-4cce-ab4c-ebfb3f2ad7ec None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.493867 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:38.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:38.500241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:38.501045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 129/260] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:38.503612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.504270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.504555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.504851 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.506564 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.522752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c051f-ce53-4525-b839-3051ce847811 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.523597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:38.539058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:38.539439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:38.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:38.543707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:38.545772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.545772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.545772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 132/261] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:38.546549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] RBAC: Adding query filter params (name=member) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:38.546549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.546549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:23:38.546549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:23:38.546549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:23:38.546549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.553861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.555284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 130/262] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:38.566161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.570610 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02496-8cf5-40f4-8049-18bff80aecf4 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.583676 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea2ec1-8fca-4de5-a0d6-92b1b6595f1e admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.585411 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.586107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.586405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.586831 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.587480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:38.587794 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.590106 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:23:38.590106 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:23:38.590106 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:23:38.591092 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.597515 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.598222 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.598508 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.598776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.610041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:23:38.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:23:38.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:23:38.612284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.612968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 133/263] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:38.615174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 131/264] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:38.618737 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.620872 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.631696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582062c2-0b80-424c-92e0-a58a7df02e6e admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.634469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d53d27-1cb2-42be-9299-29a454655853 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.643974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.644609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.645389 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18925ecc-79e3-4178-863a-f0dbb8c393fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.645997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925ecc-79e3-4178-863a-f0dbb8c393fe admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.646267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925ecc-79e3-4178-863a-f0dbb8c393fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.646533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925ecc-79e3-4178-863a-f0dbb8c393fe admin admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.647067 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.647341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.648449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18925ecc-79e3-4178-863a-f0dbb8c393fe admin admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.649121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.650123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:23:38.650123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:23:38.650123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:23:38.652402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18925ecc-79e3-4178-863a-f0dbb8c393fe admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.654219 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 132/265] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:38.656298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.657879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 134/266] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:38.659161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8977fe-cf84-44fb-8f4a-418bdf99e311 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.659584 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8977fe-cf84-44fb-8f4a-418bdf99e311 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.659855 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8977fe-cf84-44fb-8f4a-418bdf99e311 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.662125 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.663383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 133/267] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:38.665734 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8977fe-cf84-44fb-8f4a-418bdf99e311 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.675517 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66323c14-688e-42e9-844e-a7e1c9d7fc39 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.683382 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc0713-6a0a-42da-ada8-b4124cc46600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.684023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0713-6a0a-42da-ada8-b4124cc46600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0713-6a0a-42da-ada8-b4124cc46600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.684595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0713-6a0a-42da-ada8-b4124cc46600 admin admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e/groups/01799ad057fd45db863a3b6c85613449/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.687177 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc0713-6a0a-42da-ada8-b4124cc46600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393fe81231a348e7b30284cd804f160e, group_id=01799ad057fd45db863a3b6c85613449, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.688114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-97bc0713-6a0a-42da-ada8-b4124cc46600 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:23:38.688114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:23:38.688114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:23:38.690222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc0713-6a0a-42da-ada8-b4124cc46600 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.697688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8977fe-cf84-44fb-8f4a-418bdf99e311 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.707018 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.709688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.710234 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.711746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 135/268] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 00:23:38 2022] PUT /identity/v3/projects/393fe81231a348e7b30284cd804f160e/groups/01799ad057fd45db863a3b6c85613449/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:38.712086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.713552 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.716536 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a1d1-2674-41d6-9a3c-769392b74c23 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.717064 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a1d1-2674-41d6-9a3c-769392b74c23 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.717552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a1d1-2674-41d6-9a3c-769392b74c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.718568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.724010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 134/269] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 00:23:38 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:38.728563 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:38.749495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546264-1285-4600-87dd-e97ddbead5ad admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:38.758088 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ca31a1d1-2674-41d6-9a3c-769392b74c23 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:38.759902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ca31a1d1-2674-41d6-9a3c-769392b74c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:38.832559 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 136/270] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:23:38.869638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:38.870326 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:38.870609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:38.870882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e/groups/01799ad057fd45db863a3b6c85613449/roles/f411ad648adf4ef4bb52b64d0f648fff` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:38.878887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] RBAC: Authorizing `identity:create_grant(project_id=393fe81231a348e7b30284cd804f160e, group_id=01799ad057fd45db863a3b6c85613449, role_id=f411ad648adf4ef4bb52b64d0f648fff)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:38.879958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:23:38.879958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:23:38.879958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:23:38.882020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:38.914277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 135/271] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 00:23:38 2022] PUT /identity/v3/projects/393fe81231a348e7b30284cd804f160e/groups/01799ad057fd45db863a3b6c85613449/roles/f411ad648adf4ef4bb52b64d0f648fff => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:39.173874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a1d1-2674-41d6-9a3c-769392b74c23 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:39.184330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a1d1-2674-41d6-9a3c-769392b74c23 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:39.260460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:39.261537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:39.262062 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:39.262551 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:39.274461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:39.281590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:39.287211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:39.288134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:39.288920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 137/272] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 00:23:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:39.296526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:39.307731 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c660-b070-4af7-84b6-12b9634e728f admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:39.314758 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:39.315383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:39.315668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:39.315944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:39.316622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] RBAC: Adding query filter params (name=member) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:39.316955 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:39.318551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:39.329470 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 136/273] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:39.334985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:39.346537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37361-ea4b-46a0-8bf2-dc5d867af092 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:39.352498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:39.353244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:39.353501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:39.354685 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:39.356539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:39.359245 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:39.361202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 138/274] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 00:23:39 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:39.366707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:39.377882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7904f2c-fed7-4761-bdde-7a9392127c6a admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:39.382697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e1116-13f6-46dd-8f9b-f67bd8799d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:39.383334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1116-13f6-46dd-8f9b-f67bd8799d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:39.383617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1116-13f6-46dd-8f9b-f67bd8799d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:39.383946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1116-13f6-46dd-8f9b-f67bd8799d6a admin admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:39.385105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e1116-13f6-46dd-8f9b-f67bd8799d6a admin admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:39.387343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e1116-13f6-46dd-8f9b-f67bd8799d6a admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:39.389088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 137/275] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 00:23:39 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:39.395069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:39.406441 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b79b5-df47-402e-89c0-339ba157dfd3 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:39.411188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82c5c6-a24f-4570-8b0a-bed53779224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:39.412152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82c5c6-a24f-4570-8b0a-bed53779224b admin admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:39.412439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82c5c6-a24f-4570-8b0a-bed53779224b admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:39.412715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82c5c6-a24f-4570-8b0a-bed53779224b admin admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/groups/01799ad057fd45db863a3b6c85613449/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:39.415089 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82c5c6-a24f-4570-8b0a-bed53779224b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf60a1a3164d17bdd51d5818fe6856, group_id=01799ad057fd45db863a3b6c85613449, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:39.418005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82c5c6-a24f-4570-8b0a-bed53779224b admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:39.446442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 139/276] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 00:23:39 2022] PUT /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/groups/01799ad057fd45db863a3b6c85613449/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:39.680631 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117e6a3-ade2-4b8f-aa2e-6021185518fc None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:39.681031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117e6a3-ade2-4b8f-aa2e-6021185518fc None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:39.681224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117e6a3-ade2-4b8f-aa2e-6021185518fc None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:39.682786 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 138/277] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:39.697090 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301f0e-e9e8-4800-8ca8-12b9195de981 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:39.697364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301f0e-e9e8-4800-8ca8-12b9195de981 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:39.697560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301f0e-e9e8-4800-8ca8-12b9195de981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:39.724574 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-9d301f0e-e9e8-4800-8ca8-12b9195de981 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:39.725803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9d301f0e-e9e8-4800-8ca8-12b9195de981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:39.815506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 140/278] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:40.221489 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82093500-f80b-419c-bac4-c17d1aea269f None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.222003 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82093500-f80b-419c-bac4-c17d1aea269f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.222003 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82093500-f80b-419c-bac4-c17d1aea269f None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.223608 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 139/279] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:40.236307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea993b-6e4b-437c-9f08-ec5b2f1211fb None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.236591 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea993b-6e4b-437c-9f08-ec5b2f1211fb None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.236879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea993b-6e4b-437c-9f08-ec5b2f1211fb None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.238176 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 140/280] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:40.238689 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69595e-3b03-4f5b-ba75-5f78440c4de4 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.238971 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69595e-3b03-4f5b-ba75-5f78440c4de4 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.239243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69595e-3b03-4f5b-ba75-5f78440c4de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.246581 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c024a0-286f-4c02-be41-6f495fe5405d None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.246880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c024a0-286f-4c02-be41-6f495fe5405d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.247122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c024a0-286f-4c02-be41-6f495fe5405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.284879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-f5c024a0-286f-4c02-be41-6f495fe5405d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:40.286100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-f5c024a0-286f-4c02-be41-6f495fe5405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:40.288198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-9e69595e-3b03-4f5b-ba75-5f78440c4de4 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:40.289418 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9e69595e-3b03-4f5b-ba75-5f78440c4de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:40.400598 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:40.417468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 141/281] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:23:40.417920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 141/282] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 00:23:40.418857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69595e-3b03-4f5b-ba75-5f78440c4de4 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:40.500107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:40.550187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69595e-3b03-4f5b-ba75-5f78440c4de4 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:40.600426 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:40.601084 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.601361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.601629 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.617707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:40.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:40.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:40.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 142/283] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:40.629750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c024a0-286f-4c02-be41-6f495fe5405d None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:40.764998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c024a0-286f-4c02-be41-6f495fe5405d None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:40.812929 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:40.813899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.814383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.814875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.815777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:40.816293 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:40.817898 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:40.827787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 142/284] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:40.833104 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:40.888158 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:40.901742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848b78-4cad-4672-9bac-85e55b27fbc3 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:40.913201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:40.914140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.914625 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.915120 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.947161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:40.953486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:40.954357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:40.955123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:40.957742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 143/285] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:40.966086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:40.976321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92f57c-911c-4c13-85a5-d49c18556986 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:40.988191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:40.989171 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:40.989681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:40.990158 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:40.991060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:40.991576 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:40.993422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.004312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 144/286] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 00:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:41.005557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.032306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2d1bb-8af5-4deb-a20d-55bcc228d3ad admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.043624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.044260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.044533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.044801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.047755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be3fa0-593f-4a73-b19b-a35d4675edb2 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.071220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:41.076437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:41.077334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:41.078141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:41.081408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:41.084790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 145/287] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 00:23:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:41.085665 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.108458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1129002-e661-4c7c-9c51-c05012af15a7 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.112460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.113120 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.113400 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.113673 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] PATH_INFO: `/v3/users/aae422937ba34f5ca690c39766b67624` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.115100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] RBAC: Authorizing `identity:get_user(user_id=aae422937ba34f5ca690c39766b67624)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.116530 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.118122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 143/288] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:23:40 2022] GET /identity/v3/users/aae422937ba34f5ca690c39766b67624 => generated 293 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:41.121261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.122123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.122889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.123096 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.123403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] PATH_INFO: `/v3/groups/b07ec8b4bc4c45a8ba212bfbd429da64` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.131919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] RBAC: Authorizing `identity:get_group(group_id=b07ec8b4bc4c45a8ba212bfbd429da64)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.134245 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.136171 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 146/289] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 00:23:41 2022] GET /identity/v3/groups/b07ec8b4bc4c45a8ba212bfbd429da64 => generated 229 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:41.137200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.142889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedbf73-54d1-4306-937f-7da7f8604c44 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.154332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.155681 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.155962 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.156224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.156922 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:41.157225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.158814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.172363 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:41.179132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 144/290] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 00:23:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:41.179991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.205799 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be94e85-5172-4c23-a016-cf3ea582d7a9 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.214189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.215278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.216703 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.218508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] PATH_INFO: `/v3/projects/7112d45203474f9493cb8a682f790adf` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.219907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] RBAC: Authorizing `identity:get_project(project_id=7112d45203474f9493cb8a682f790adf)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.224306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.229270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 145/291] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 00:23:41 2022] GET /identity/v3/projects/7112d45203474f9493cb8a682f790adf => generated 344 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:41.230672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.254451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e8a7b-551d-43f7-bd1c-a9dff16804fa admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.264113 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.265300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.266949 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.267687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.270108 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.275764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.278991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 146/292] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 00:23:41 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:41.280700 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.300714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541b25-552e-467c-97d6-d3360c789070 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.310452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.311616 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.312989 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.314448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] PATH_INFO: `/v3/projects/7112d45203474f9493cb8a682f790adf/groups/b07ec8b4bc4c45a8ba212bfbd429da64/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.318838 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7112d45203474f9493cb8a682f790adf, group_id=b07ec8b4bc4c45a8ba212bfbd429da64, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.322671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.330218 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2549c4-1cb7-4a74-be4c-2c53b83a33d8 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.351070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 147/293] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 00:23:41 2022] PUT /identity/v3/projects/7112d45203474f9493cb8a682f790adf/groups/b07ec8b4bc4c45a8ba212bfbd429da64/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:41.352212 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.407051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.407691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.407963 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.408822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.409706 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] RBAC: Adding query filter params (role.id=88d42d2fdec94576b571dd7a1624a685, user.id=aae422937ba34f5ca690c39766b67624, scope.system=all) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:41.410412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.412048 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.439028 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 147/294] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 00:23:41 2022] GET /identity/v3/role_assignments?user.id=aae422937ba34f5ca690c39766b67624&scope.system=all&role.id=88d42d2fdec94576b571dd7a1624a685 => generated 510 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:41.455855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c784f9d-9c12-45c7-b208-350b6e1c1e89 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.460957 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145faf23-7a57-43a2-88db-ffec227a9fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.461846 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faf23-7a57-43a2-88db-ffec227a9fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.462327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faf23-7a57-43a2-88db-ffec227a9fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.462789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faf23-7a57-43a2-88db-ffec227a9fb2 admin admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.464153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145faf23-7a57-43a2-88db-ffec227a9fb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.466704 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145faf23-7a57-43a2-88db-ffec227a9fb2 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.469475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 148/295] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 00:23:41 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:41.475168 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:41.488099 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab7d6e-775a-40fc-8e48-40767923d6f8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:41.493047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54df96-a4af-4ad4-89ce-364d97475563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:41.494000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54df96-a4af-4ad4-89ce-364d97475563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:41.494524 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54df96-a4af-4ad4-89ce-364d97475563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:41.495087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54df96-a4af-4ad4-89ce-364d97475563 admin admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/groups/01799ad057fd45db863a3b6c85613449/roles/f411ad648adf4ef4bb52b64d0f648fff` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:41.497532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54df96-a4af-4ad4-89ce-364d97475563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf60a1a3164d17bdd51d5818fe6856, group_id=01799ad057fd45db863a3b6c85613449, role_id=f411ad648adf4ef4bb52b64d0f648fff)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:41.500868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54df96-a4af-4ad4-89ce-364d97475563 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:41.533164 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 148/296] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 00:23:41 2022] PUT /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856/groups/01799ad057fd45db863a3b6c85613449/roles/f411ad648adf4ef4bb52b64d0f648fff => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:23:42.127527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea21c3-9318-40f3-84c0-7c9acb949292 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:42.128026 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea21c3-9318-40f3-84c0-7c9acb949292 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:42.128100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea21c3-9318-40f3-84c0-7c9acb949292 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:42.129775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 149/297] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:42.135148 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e408d9e-ca08-4ebe-a579-33555ab32011 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:42.135439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e408d9e-ca08-4ebe-a579-33555ab32011 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:42.135714 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e408d9e-ca08-4ebe-a579-33555ab32011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:42.163180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-0e408d9e-ca08-4ebe-a579-33555ab32011 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:42.164681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-0e408d9e-ca08-4ebe-a579-33555ab32011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:42.248092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:42.258783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 149/298] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:42.303018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a929d-0d19-47c6-993f-ee20d2775655 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:42.303321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a929d-0d19-47c6-993f-ee20d2775655 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:42.303573 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a929d-0d19-47c6-993f-ee20d2775655 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:42.305065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 150/299] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:42.311653 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed8528-44b5-41aa-aad3-19dbdb9e7589 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:42.311889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed8528-44b5-41aa-aad3-19dbdb9e7589 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:42.312149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed8528-44b5-41aa-aad3-19dbdb9e7589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:42.331128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-54ed8528-44b5-41aa-aad3-19dbdb9e7589 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:42.332310 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-54ed8528-44b5-41aa-aad3-19dbdb9e7589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:42.409289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 150/300] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:42.712114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdf935-fc3b-4fb6-b75c-371df05ebe79 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:42.712114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdf935-fc3b-4fb6-b75c-371df05ebe79 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:42.712114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdf935-fc3b-4fb6-b75c-371df05ebe79 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:42.712904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 151/301] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:42.718575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0744-1bf1-415e-a196-5d4b84a4c3b5 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:42.719119 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0744-1bf1-415e-a196-5d4b84a4c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:42.719614 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0744-1bf1-415e-a196-5d4b84a4c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:42.738826 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-48fc0744-1bf1-415e-a196-5d4b84a4c3b5 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:42.741846 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-48fc0744-1bf1-415e-a196-5d4b84a4c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:42.809485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdf935-fc3b-4fb6-b75c-371df05ebe79 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:42.833190 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 151/302] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:42.965252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdf935-fc3b-4fb6-b75c-371df05ebe79 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:42.968121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:43.003507 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.004147 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.004429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.004702 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.016992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:43.018800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc0744-1bf1-415e-a196-5d4b84a4c3b5 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:43.022157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:43.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:43.023752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 152/303] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:23:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:43.035772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.142005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:43.157921 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aac23-607f-491b-b02a-18bc9455ee93 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.195291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.195904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.196239 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.196519 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.197384 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:43.197694 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:43.199089 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:43.207937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 153/304] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:43.218272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.223201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc0744-1bf1-415e-a196-5d4b84a4c3b5 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.258921 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:43.269876 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.270803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.271232 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.271673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.284794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:43.290429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:43.291466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:43.292420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:43.296452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 152/305] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:43.297588 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.343885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676854d-9192-4536-ad8a-e11518d946f5 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.381729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.382344 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.382629 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.383112 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.433880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde714b-a63b-4e77-a9c6-33f0a32dabbf None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.454792 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:43.459529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:43.460974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:43.474668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.475551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.476008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.476454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.490190 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:43.491378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:43.496418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:43.497329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 00:23:43.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:43.501355 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 153/306] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:43.502324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.576861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 154/307] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 00:23:43.576861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.659555 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f734730-9e00-422c-a585-6514d7e6ff6d None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.692607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e63424-a10a-42de-88e9-cf3d34fc58f7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.706469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.707236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.707640 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.707918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.708590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] RBAC: Adding query filter params (name=member) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:43.708925 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:43.713001 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:43.723606 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 154/308] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:43.724237 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.731452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:43.741153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.741882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.742064 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.742315 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.743013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:43.743428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:43.744741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:43.757088 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 155/309] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:43.757974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.801198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:43.870063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a79ab3-d936-44d9-beef-1442e2b92261 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.899768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c05272-6276-4ca7-8b48-f705e6aa6b86 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:43.922860 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.923507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.923791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.924064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:43.925243 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:43.926851 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:43.929311 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 155/310] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:43.932248 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:43.954336 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:43.955004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:43.955289 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:43.955566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:44.047735 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.049340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c5f9e-26f4-4f50-8411-5c8d1f1d07e7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:44.075935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:44.111623 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:44.112535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.112535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.112782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.177136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 156/311] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:44.178841 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:44.203378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.205157 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.303261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:44.321759 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741212e-8938-43de-b4a9-df54a06d7e1d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:44.376032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7344ca0-5d28-4b7c-8c00-8a3bda4eee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:44.376670 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344ca0-5d28-4b7c-8c00-8a3bda4eee4b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.376977 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344ca0-5d28-4b7c-8c00-8a3bda4eee4b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.377251 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344ca0-5d28-4b7c-8c00-8a3bda4eee4b None admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.378376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7344ca0-5d28-4b7c-8c00-8a3bda4eee4b None admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.379120 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 156/312] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:44.379803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7344ca0-5d28-4b7c-8c00-8a3bda4eee4b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.380396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:44.381824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 157/313] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 00:23:44 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:44.383011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab709-95aa-4ddd-973b-ab9b16d0f8f6 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.383287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab709-95aa-4ddd-973b-ab9b16d0f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.383556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab709-95aa-4ddd-973b-ab9b16d0f8f6 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.384899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 158/314] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:44.385458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab709-95aa-4ddd-973b-ab9b16d0f8f6 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:44.395342 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:44.497397 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0772f-2f52-444c-9d67-e0bc8878f2ab None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:44.509262 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab709-95aa-4ddd-973b-ab9b16d0f8f6 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:44.535738 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:44.536373 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.536931 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.537205 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] PATH_INFO: `/v3/projects/393fe81231a348e7b30284cd804f160e` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.538320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] RBAC: Authorizing `identity:get_project(project_id=393fe81231a348e7b30284cd804f160e)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.539751 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.541762 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 157/315] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:44 2022] GET /identity/v3/projects/393fe81231a348e7b30284cd804f160e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:44.542585 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:44.551537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da30c1-4e2e-4917-a436-5e46cc82fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:44.552180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da30c1-4e2e-4917-a436-5e46cc82fcdc None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.552460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da30c1-4e2e-4917-a436-5e46cc82fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.552731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da30c1-4e2e-4917-a436-5e46cc82fcdc None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.556464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da30c1-4e2e-4917-a436-5e46cc82fcdc None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.557889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da30c1-4e2e-4917-a436-5e46cc82fcdc None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.559535 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 159/316] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:44 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:44.560805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03fc7e-e89d-4a36-85cf-d0396d86e55d None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.561599 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03fc7e-e89d-4a36-85cf-d0396d86e55d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.561869 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03fc7e-e89d-4a36-85cf-d0396d86e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.582002 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-6a03fc7e-e89d-4a36-85cf-d0396d86e55d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:44.583461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6a03fc7e-e89d-4a36-85cf-d0396d86e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:44.604406 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:44.641924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:44.666399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 160/317] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:44.667878 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1c12f-cbf0-423a-a58f-bac2f35e5be8 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.668292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1c12f-cbf0-423a-a58f-bac2f35e5be8 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.668693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1c12f-cbf0-423a-a58f-bac2f35e5be8 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.670715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 161/318] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:44.671539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1c12f-cbf0-423a-a58f-bac2f35e5be8 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:44.675023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ab0e4-eb92-446a-a2cc-77d2b120991a None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:44.716026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:44.716957 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.717382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.717891 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.718787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] RBAC: Adding query filter params (group.id=01799ad057fd45db863a3b6c85613449, role.id=f411ad648adf4ef4bb52b64d0f648fff, scope.project.id=393fe81231a348e7b30284cd804f160e) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:44.719102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.720521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.728738 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 158/319] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 00:23:44 2022] GET /identity/v3/role_assignments?group.id=01799ad057fd45db863a3b6c85613449&scope.project.id=393fe81231a348e7b30284cd804f160e&role.id=f411ad648adf4ef4bb52b64d0f648fff => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:44.730036 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:44.852597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1c12f-cbf0-423a-a58f-bac2f35e5be8 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:44.871903 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bfd92-ac2d-4048-bd80-ccf0a725d199 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:44.903039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972df46-e48c-4c72-a843-8b3a7b8c2a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:44.903693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972df46-e48c-4c72-a843-8b3a7b8c2a95 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.903975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972df46-e48c-4c72-a843-8b3a7b8c2a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.905048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972df46-e48c-4c72-a843-8b3a7b8c2a95 None admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.906981 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972df46-e48c-4c72-a843-8b3a7b8c2a95 None admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.908486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972df46-e48c-4c72-a843-8b3a7b8c2a95 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.910415 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 162/320] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 00:23:44 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:44.911724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96eff-4a08-4207-9506-89822939750d None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.912065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96eff-4a08-4207-9506-89822939750d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.912338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96eff-4a08-4207-9506-89822939750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.937532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:44.938568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:44.938851 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:44.939198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:44.940228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-29c96eff-4a08-4207-9506-89822939750d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:44.940418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:44.941939 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-29c96eff-4a08-4207-9506-89822939750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:44.942049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:44.943930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 159/321] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 00:23:44 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:44.945038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:44.958347 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:44.966603 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:45.034952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:45.036038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c96eff-4a08-4207-9506-89822939750d None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.074825 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe3850-79fe-4d68-9261-4d9a809f72af None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.123679 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.124216 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.124498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.124769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.125553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] RBAC: Adding query filter params (group.id=01799ad057fd45db863a3b6c85613449, role.id=c1be01f06d6d4babaadc2a4809ef9dfc, scope.project.id=393fe81231a348e7b30284cd804f160e) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:45.125863 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:45.127282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:45.133721 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 160/323] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 00:23:44 2022] GET /identity/v3/role_assignments?group.id=01799ad057fd45db863a3b6c85613449&scope.project.id=393fe81231a348e7b30284cd804f160e&role.id=c1be01f06d6d4babaadc2a4809ef9dfc => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:45.134350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.161279 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c96eff-4a08-4207-9506-89822939750d None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.208314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.209806 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.210651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.211443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.212395 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] RBAC: Adding query filter params (group.id=01799ad057fd45db863a3b6c85613449, role.id=c1be01f06d6d4babaadc2a4809ef9dfc, scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:45.212956 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:45.214823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:45.220095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:45.225451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 164/324] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/role_assignments?group.id=01799ad057fd45db863a3b6c85613449&scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856&role.id=c1be01f06d6d4babaadc2a4809ef9dfc => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:45.265947 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db724c2e-b91b-423a-8d3a-c4c0d9ac1bf8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.311673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.312345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.312620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.312946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.326068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:45.332046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:45.333140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:45.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 161/325] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:45.339516 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.349296 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.378896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:45.481431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fe53f-ad9c-4a25-810c-02925f7fd967 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.489354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d3d98-fba4-4fd9-ad9f-057c5588ffe7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.516975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:45.523597 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.524230 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.524506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.524777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.537902 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:45.542523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.543138 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:45.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:45.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:45.544809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:45.545907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.545907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.545907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:45.546080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 162/326] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:45.546145 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:45.547286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:45.552135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.556510 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 165/327] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:45.563051 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.656885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:45.673428 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92195-e7eb-4b62-9a43-f2328a446c19 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.687223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519258-497e-44ab-b89c-d62462faa358 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.714138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.715017 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.715298 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.715569 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.716396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:45.717153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:45.719116 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:45.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.727283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.727283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.727283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.728384 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 163/328] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:45.733580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.792434 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:45.805583 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:45.807864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:45.847833 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025da95-ef88-451e-a6f1-e753aa528cff None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:45.893073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:45.893273 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:45.893432 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:45.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:45.902025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:45.929726 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 166/329] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:23:45.934924 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:45.977375 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:45.978813 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:46.028594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:46.040454 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ca0ce-3e07-4e8c-afb5-9f58646c410c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:46.075548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:46.076172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:46.076710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:46.076820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] PATH_INFO: `/v3/projects/7112d45203474f9493cb8a682f790adf` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:46.076951 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 164/330] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 00:23:46.077914 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] RBAC: Authorizing `identity:get_project(project_id=7112d45203474f9493cb8a682f790adf)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:46.079417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:46.084072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 167/331] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:45 2022] GET /identity/v3/projects/7112d45203474f9493cb8a682f790adf => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:46.085182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:46.086629 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:46.132700 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:46.182851 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c12aa-5a5b-427c-bdc0-363760ef8e1b None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:46.183596 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bf57f-cd33-4648-8e9b-7283c89c7a8d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:46.216546 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:46.217247 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:46.217529 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:46.217652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:46.218087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] PATH_INFO: `/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:46.218283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:46.218567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:46.218840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] PATH_INFO: `/v3/groups/b07ec8b4bc4c45a8ba212bfbd429da64` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:46.218924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] RBAC: Authorizing `identity:get_project(project_id=b8bf60a1a3164d17bdd51d5818fe6856)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:46.219937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] RBAC: Authorizing `identity:get_group(group_id=b07ec8b4bc4c45a8ba212bfbd429da64)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:46.220318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:46.221498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:46.221986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 165/332] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:23:46 2022] GET /identity/v3/projects/b8bf60a1a3164d17bdd51d5818fe6856 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:46.223171 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 168/333] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 00:23:46 2022] GET /identity/v3/groups/b07ec8b4bc4c45a8ba212bfbd429da64 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:46.227581 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:46.230308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:46.251105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:46.327513 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f493-7d32-4b86-98d1-5a0f37f04023 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:46.328996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4716f7e-d768-4fbf-8df2-8b8807d9395c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:46.342783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:46.362069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:46.362693 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:46.362974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:46.363125 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f2f48-4cb0-4c4a-b1ad-db4ddd326be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:46.363248 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] PATH_INFO: `/v3/groups/01799ad057fd45db863a3b6c85613449` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:46.363716 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2f48-4cb0-4c4a-b1ad-db4ddd326be4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:46.363996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2f48-4cb0-4c4a-b1ad-db4ddd326be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:46.364263 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2f48-4cb0-4c4a-b1ad-db4ddd326be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:46.364350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] RBAC: Authorizing `identity:get_group(group_id=01799ad057fd45db863a3b6c85613449)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:46.365005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f2f48-4cb0-4c4a-b1ad-db4ddd326be4 None admin] RBAC: Adding query filter params (group.id=b07ec8b4bc4c45a8ba212bfbd429da64, role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=7112d45203474f9493cb8a682f790adf) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:46.365314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f2f48-4cb0-4c4a-b1ad-db4ddd326be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:46.365790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:46.366708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f2f48-4cb0-4c4a-b1ad-db4ddd326be4 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:46.367360 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 166/334] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 00:23:46 2022] GET /identity/v3/groups/01799ad057fd45db863a3b6c85613449 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:46.372740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 169/335] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 00:23:46 2022] GET /identity/v3/role_assignments?group.id=b07ec8b4bc4c45a8ba212bfbd429da64&scope.project.id=7112d45203474f9493cb8a682f790adf&role.id=08d7ebb3d6044305874059d45f17c926 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:46.373066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:46.477158 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:46.490241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56677e85-78c5-4806-8b80-7a319efb42c9 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:46.526719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c881fb0-ea42-4229-87b6-b763714eaa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:46.527435 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881fb0-ea42-4229-87b6-b763714eaa9f None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:46.527599 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881fb0-ea42-4229-87b6-b763714eaa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:46.527870 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881fb0-ea42-4229-87b6-b763714eaa9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:46.528611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c881fb0-ea42-4229-87b6-b763714eaa9f None admin] RBAC: Adding query filter params (group.id=01799ad057fd45db863a3b6c85613449, role.id=f411ad648adf4ef4bb52b64d0f648fff, scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:46.528949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c881fb0-ea42-4229-87b6-b763714eaa9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:46.530499 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c881fb0-ea42-4229-87b6-b763714eaa9f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:46.537279 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 167/336] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 00:23:46 2022] GET /identity/v3/role_assignments?group.id=01799ad057fd45db863a3b6c85613449&scope.project.id=b8bf60a1a3164d17bdd51d5818fe6856&role.id=f411ad648adf4ef4bb52b64d0f648fff => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:49.318422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f52e7-0cd4-4db5-96b6-54273d278810 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:49.318967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f52e7-0cd4-4db5-96b6-54273d278810 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:49.318967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f52e7-0cd4-4db5-96b6-54273d278810 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:49.320531 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 170/337] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:49.326829 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313540d-e17b-4717-925c-4add44023e9c None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:49.327650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313540d-e17b-4717-925c-4add44023e9c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:49.328140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313540d-e17b-4717-925c-4add44023e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:49.354111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-6313540d-e17b-4717-925c-4add44023e9c None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:49.355308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-6313540d-e17b-4717-925c-4add44023e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:49.441460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 168/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:49.734537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344e11-f16e-448f-b931-e85a1310c527 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:49.735052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344e11-f16e-448f-b931-e85a1310c527 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:49.735482 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344e11-f16e-448f-b931-e85a1310c527 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:49.737262 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 171/339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:49.742349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea2c5-6740-49fd-b7bb-b0f25447f59a None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:49.742747 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea2c5-6740-49fd-b7bb-b0f25447f59a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:49.743122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea2c5-6740-49fd-b7bb-b0f25447f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:49.767111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-b02ea2c5-6740-49fd-b7bb-b0f25447f59a None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:49.768309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b02ea2c5-6740-49fd-b7bb-b0f25447f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:49.768992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a031-ab04-431c-84f7-3a803bdb54fa None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:49.769492 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a031-ab04-431c-84f7-3a803bdb54fa None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:49.769980 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a031-ab04-431c-84f7-3a803bdb54fa None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:49.771769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 172/340] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:49.776346 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ce50-a548-4a7b-9f5b-525056b3cf0e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:49.776895 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ce50-a548-4a7b-9f5b-525056b3cf0e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:49.777388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ce50-a548-4a7b-9f5b-525056b3cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:49.810073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-eda7ce50-a548-4a7b-9f5b-525056b3cf0e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:49.812382 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-eda7ce50-a548-4a7b-9f5b-525056b3cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:49.846044 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 169/341] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:49.852502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ea2c5-6740-49fd-b7bb-b0f25447f59a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:49.869202 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:49.964726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ea2c5-6740-49fd-b7bb-b0f25447f59a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:50.002040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:50.002913 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.003351 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.003773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.014925 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:50.016626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:50.034102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:50.035318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:50.036395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:50.036395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.036395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:50.038836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 170/342] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:50.046373 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 173/343] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:50.047668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:50.144051 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7ce50-a548-4a7b-9f5b-525056b3cf0e None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:50.169201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:50.223890 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca247f5-39b5-4caa-bd3e-3226ec9d895c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:50.268542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d721629-b429-4dee-a855-e58e02f8043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:50.269476 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721629-b429-4dee-a855-e58e02f8043e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.269756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721629-b429-4dee-a855-e58e02f8043e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.270026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721629-b429-4dee-a855-e58e02f8043e None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.270675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d721629-b429-4dee-a855-e58e02f8043e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:50.270977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d721629-b429-4dee-a855-e58e02f8043e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:50.272910 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d721629-b429-4dee-a855-e58e02f8043e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:50.286486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7ce50-a548-4a7b-9f5b-525056b3cf0e None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:50.288654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 171/344] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:50.294107 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970301f-00a3-49ee-900b-df12e2b09442 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.294398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970301f-00a3-49ee-900b-df12e2b09442 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.294670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970301f-00a3-49ee-900b-df12e2b09442 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.296491 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 172/345] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:50.301092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970301f-00a3-49ee-900b-df12e2b09442 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:50.304217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:50.335931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182a94e-989c-4660-b7a3-9c24c4a70592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:50.337514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a94e-989c-4660-b7a3-9c24c4a70592 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.338114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a94e-989c-4660-b7a3-9c24c4a70592 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.338612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182a94e-989c-4660-b7a3-9c24c4a70592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.350355 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182a94e-989c-4660-b7a3-9c24c4a70592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:50.351810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182a94e-989c-4660-b7a3-9c24c4a70592 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-7182a94e-989c-4660-b7a3-9c24c4a70592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:50.367148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:50.368248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:50.369490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:50.369490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.369490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:50.369490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 174/346] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:50.369490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8f61-028c-45d1-a2f8-dbdb0ab9196c None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.369788 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8f61-028c-45d1-a2f8-dbdb0ab9196c None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.369973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8f61-028c-45d1-a2f8-dbdb0ab9196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.388318 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-4fea8f61-028c-45d1-a2f8-dbdb0ab9196c None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:50.390174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4fea8f61-028c-45d1-a2f8-dbdb0ab9196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:50.425843 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970301f-00a3-49ee-900b-df12e2b09442 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:50.453012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:50.460819 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 175/347] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:50.461852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8f61-028c-45d1-a2f8-dbdb0ab9196c None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:50.473905 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:50.474778 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.475244 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.475827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.476483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:50.478057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:50.512861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 173/348] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:50 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:50.512861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:50.647278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:50.668748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8f61-028c-45d1-a2f8-dbdb0ab9196c None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:50.725213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96715bb-2dfe-4199-a93d-a365929da354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:50.725859 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96715bb-2dfe-4199-a93d-a365929da354 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.726139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96715bb-2dfe-4199-a93d-a365929da354 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.726411 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96715bb-2dfe-4199-a93d-a365929da354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.734216 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32fce0-3d2d-45e1-956b-4f427e283e4f None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:50.743424 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96715bb-2dfe-4199-a93d-a365929da354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:50.744908 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96715bb-2dfe-4199-a93d-a365929da354 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-e96715bb-2dfe-4199-a93d-a365929da354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:50.762797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:50.763809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:50.764634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:50.764634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.764634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:50.764634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 176/349] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:50.765308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe00acd-190e-47db-843d-6f50f82e31ba None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.765414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe00acd-190e-47db-843d-6f50f82e31ba None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.767602 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe00acd-190e-47db-843d-6f50f82e31ba None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.767602 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 177/350] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:50.767602 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe00acd-190e-47db-843d-6f50f82e31ba None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:50.784584 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2f3eb-87c0-4f45-b18f-3eb82abec30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:50.785207 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f3eb-87c0-4f45-b18f-3eb82abec30a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.785485 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f3eb-87c0-4f45-b18f-3eb82abec30a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.785753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2f3eb-87c0-4f45-b18f-3eb82abec30a None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.786399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2f3eb-87c0-4f45-b18f-3eb82abec30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:50.787053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2f3eb-87c0-4f45-b18f-3eb82abec30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:50.788427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2f3eb-87c0-4f45-b18f-3eb82abec30a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:50.801105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 174/351] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:50.806426 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859d94-9367-485b-bcf2-220c27ba3b66 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.806716 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859d94-9367-485b-bcf2-220c27ba3b66 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.806995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df859d94-9367-485b-bcf2-220c27ba3b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.827697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-df859d94-9367-485b-bcf2-220c27ba3b66 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:50.829181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-df859d94-9367-485b-bcf2-220c27ba3b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:50.866295 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:50.882279 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe00acd-190e-47db-843d-6f50f82e31ba None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:50.901719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 175/352] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:50.902828 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df859d94-9367-485b-bcf2-220c27ba3b66 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:50.946744 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:50.948164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:50.948164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:50.948164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:50.959532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:50.961012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:50.963528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:50.981013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:50.981926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:50.983597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:50.983597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:50.983597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:50.983597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 178/353] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:50.983597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:51.034571 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df859d94-9367-485b-bcf2-220c27ba3b66 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:51.079949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:51.080566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:51.081466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:51.081760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:51.082421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:51.082782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:51.085110 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:51.101001 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 176/354] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:51.101944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:51.115274 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591979a-7e5a-4545-a78f-fca53ffd2d2d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:51.137069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:51.161158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:51.162787 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:51.163220 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:51.163913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:51.164805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:51.166512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:51.194482 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 179/355] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:50 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:51.195829 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:51.213220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f1b8-b4d6-4b12-b447-71756487ecfb None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:51.258695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:51.259504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:51.259789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:51.260077 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:51.261502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:51.261967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:51.264206 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:51.273250 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:51.283177 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 177/356] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:51.284224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:51.335527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3c01-ca60-47e6-8d22-ac43341c8580 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:51.390063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:51.390700 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:51.390924 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:51.391127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:51.391812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:51.393301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:51.410915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:51.421763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 180/357] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:51 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:51.422648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:51.425568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc67f-5669-4bfc-b332-006c6d7fb497 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:51.471130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:51.471747 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:51.472032 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:51.472794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:51.473785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:51.475448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:51.484428 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.sql.core [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:23:51.484428 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 00:23:51.484428 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [parameters: {'id': 'a8de8657936a46c2bf04aad66a21b083', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 00:23:51.484428 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81477) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result.read() Oct 19 00:23:51.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return ref.to_dict() Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:23:51.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application yield resource Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise self.value Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application session.commit() Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:23:51.506997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:23:51.507802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:23:51.508645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result.read() Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:23:51.509437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [parameters: {'id': 'a8de8657936a46c2bf04aad66a21b083', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:51.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 00:23:51.510969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:51.511850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 178/358] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 00:23:51 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:51.518650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:51.646333 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c7fda-82bb-4a0d-acaf-fbc799aa09dc None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:51.658111 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:51.705309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:51.705855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:51.706139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:51.706416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:51.707636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:51.709449 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:51.721400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1da05-42aa-420f-994f-53549d46ae57 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:51.742609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 181/359] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:51 2022] POST /identity/v3/users => generated 249 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:51.774421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff99a9-df93-4f2d-9e24-591e2cf29f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:51.775143 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff99a9-df93-4f2d-9e24-591e2cf29f2d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:51.775477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff99a9-df93-4f2d-9e24-591e2cf29f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:51.775756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff99a9-df93-4f2d-9e24-591e2cf29f2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:51.789060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff99a9-df93-4f2d-9e24-591e2cf29f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e5ff99a9-df93-4f2d-9e24-591e2cf29f2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:51.794672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:51.795612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 00:23:51.796372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:51.797033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 179/360] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:23:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:51.803952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:51.964952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced67048-a7fd-4517-a99b-0e156725b63c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:52.000710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac4a1c-e5d0-403b-a49c-dfabf3e30743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:52.001361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac4a1c-e5d0-403b-a49c-dfabf3e30743 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:52.001646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac4a1c-e5d0-403b-a49c-dfabf3e30743 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:52.001920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac4a1c-e5d0-403b-a49c-dfabf3e30743 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:52.002592 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac4a1c-e5d0-403b-a49c-dfabf3e30743 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:52.002900 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac4a1c-e5d0-403b-a49c-dfabf3e30743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:52.004330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac4a1c-e5d0-403b-a49c-dfabf3e30743 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:52.012886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 182/361] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:53.017731 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57e51-e30d-4ee6-a41b-11a18fdc46c5 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:53.018239 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57e51-e30d-4ee6-a41b-11a18fdc46c5 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:53.018309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57e51-e30d-4ee6-a41b-11a18fdc46c5 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:53.019917 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 180/362] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:53.025403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09861-d290-4970-a67f-df97a6ad8589 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:53.025914 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09861-d290-4970-a67f-df97a6ad8589 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:53.025986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09861-d290-4970-a67f-df97a6ad8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:53.054083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-2be09861-d290-4970-a67f-df97a6ad8589 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:53.055297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-2be09861-d290-4970-a67f-df97a6ad8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:53.074489 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:53.140127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 183/363] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:53.589760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57e51-e30d-4ee6-a41b-11a18fdc46c5 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:53.607099 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:53.727523 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57e51-e30d-4ee6-a41b-11a18fdc46c5 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:53.765137 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce4387-c9ca-4e48-9b29-a61d1e6398e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:53.765779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce4387-c9ca-4e48-9b29-a61d1e6398e2 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:53.766054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce4387-c9ca-4e48-9b29-a61d1e6398e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:53.766322 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce4387-c9ca-4e48-9b29-a61d1e6398e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:53.777040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce4387-c9ca-4e48-9b29-a61d1e6398e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-35ce4387-c9ca-4e48-9b29-a61d1e6398e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:53.782695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:53.783567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:53.784345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 181/364] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:23:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:53.792265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09861-d290-4970-a67f-df97a6ad8589 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:53.957181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09861-d290-4970-a67f-df97a6ad8589 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:54.008303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c135bb7-9e89-4eab-968a-99146e881970 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.008643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c135bb7-9e89-4eab-968a-99146e881970 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.008937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c135bb7-9e89-4eab-968a-99146e881970 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.010238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 182/365] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:54.016995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a3eae-dffd-4e09-909a-b6b10e5f05a2 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.017533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a3eae-dffd-4e09-909a-b6b10e5f05a2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.018011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a3eae-dffd-4e09-909a-b6b10e5f05a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.022204 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:54.022830 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.023117 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.023450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.024124 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:54.024444 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:54.025816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:54.040956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-b63a3eae-dffd-4e09-909a-b6b10e5f05a2 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:54.042751 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b63a3eae-dffd-4e09-909a-b6b10e5f05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:54.043997 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 184/366] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:23:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:54.051261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:54.081256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:54.174346 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 183/367] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:54.225470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe019-c61b-49bd-82d3-54984a40c4fa None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:54.245151 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4071-cc0e-4fc7-b570-2558ec193dff None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.245461 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4071-cc0e-4fc7-b570-2558ec193dff None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.245701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4071-cc0e-4fc7-b570-2558ec193dff None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.247233 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 184/368] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:54.254186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61a3e-a704-4d9d-ac36-b62206654888 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.254460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61a3e-a704-4d9d-ac36-b62206654888 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.254727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61a3e-a704-4d9d-ac36-b62206654888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.273190 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:54.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:54.278310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.278804 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.279849 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.293848 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:54.295899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:54.302081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-9df61a3e-a704-4d9d-ac36-b62206654888 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:54.303326 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9df61a3e-a704-4d9d-ac36-b62206654888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:54.313632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:54.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:54.315420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:54.315420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:54.315420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:54.317396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 185/369] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:54.327846 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:54.395287 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 185/370] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:54.416034 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:54.434605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476fac-a311-4785-93f7-97ab4e693238 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.435214 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476fac-a311-4785-93f7-97ab4e693238 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.436424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476fac-a311-4785-93f7-97ab4e693238 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.438378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 186/371] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:23:54.445155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61811dd0-d931-415d-9e90-b3446bda9e58 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.445683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61811dd0-d931-415d-9e90-b3446bda9e58 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.446149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61811dd0-d931-415d-9e90-b3446bda9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.462959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d590c18-95eb-472e-8ce9-ecbebc5164b0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:54.481574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-61811dd0-d931-415d-9e90-b3446bda9e58 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:54.483964 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-61811dd0-d931-415d-9e90-b3446bda9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:54.510405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:54.511028 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.511307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.511575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.512221 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:54.512519 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:54.514509 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:54.539781 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 186/372] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:54.545625 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:54.588288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 187/373] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:23:54.596420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61811dd0-d931-415d-9e90-b3446bda9e58 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:54.705161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:54.716181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3c95-898e-4dc7-ad64-1e48daefdd4d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:54.756703 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61811dd0-d931-415d-9e90-b3446bda9e58 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:54.781228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:54.791866 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:54.792690 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.793084 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.793424 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.800739 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:54.801681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.802137 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.802595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.803975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:54.805915 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:54.813695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:54.818647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:54.819782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:54.820760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:54.821634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 188/374] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:54.822441 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:23:54.823586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:54.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:23:54.825413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:54.827103 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 187/375] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:23:54.830034 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:54.939049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca499-252d-409a-9329-98b5a22d8ac6 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:54.943363 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f518d0-c22a-440a-ab72-739d481bd06e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:54.962788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:54.973898 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61437543-6281-44db-8aad-d943374324a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:54.974526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437543-6281-44db-8aad-d943374324a4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.974806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437543-6281-44db-8aad-d943374324a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.975079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437543-6281-44db-8aad-d943374324a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.977247 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:54.977853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.978131 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.978402 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.979352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:54.979663 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:54.981078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:54.985797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61437543-6281-44db-8aad-d943374324a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:54.989526 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 188/376] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:23:54.990307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-61437543-6281-44db-8aad-d943374324a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:54.990657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:54.991553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:54.992324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 189/377] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:54.993506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c34660-32f9-4a1d-af4a-e76108d1ecab None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:54.993506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c34660-32f9-4a1d-af4a-e76108d1ecab None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:54.993728 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c34660-32f9-4a1d-af4a-e76108d1ecab None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:54.996062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 190/378] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:54.996774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c34660-32f9-4a1d-af4a-e76108d1ecab None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.045605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.095487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10774-a497-4980-9013-52d1fdb8ef8c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.099337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c34660-32f9-4a1d-af4a-e76108d1ecab None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.128669 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.129296 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.129577 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.129850 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.130566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:55.130873 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.132288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.132647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.133302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.133581 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.133855 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.143822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:55.148624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:55.149604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:55.150353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 191/379] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:55.150977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.169073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 189/380] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 00:23:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:55.170449 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.197143 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.251609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577d51-c35e-4911-89c1-414ba120e9b6 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.270717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2add3d-1de3-43c5-bbda-3e679ad1b602 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.279729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.284741 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd21f4-5844-43f9-bc1c-e52c36e705a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.285390 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd21f4-5844-43f9-bc1c-e52c36e705a2 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.285672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd21f4-5844-43f9-bc1c-e52c36e705a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.285944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd21f4-5844-43f9-bc1c-e52c36e705a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.296573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd21f4-5844-43f9-bc1c-e52c36e705a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.298039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd21f4-5844-43f9-bc1c-e52c36e705a2 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.304896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.305493 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.305770 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.306032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.306692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:55.306992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.308333 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-9cfd21f4-5844-43f9-bc1c-e52c36e705a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:55.313203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:55.314246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:55.315089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:55.315089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.315089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:55.315089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 192/381] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:55.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ed09-dace-4afc-9d7b-8d317fd75b2e None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.315842 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ed09-dace-4afc-9d7b-8d317fd75b2e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.316112 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ed09-dace-4afc-9d7b-8d317fd75b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.318816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 190/382] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:55.319754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.335823 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-0d05ed09-dace-4afc-9d7b-8d317fd75b2e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:55.337049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-0d05ed09-dace-4afc-9d7b-8d317fd75b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:55.406390 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 193/383] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:55.407210 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05ed09-dace-4afc-9d7b-8d317fd75b2e None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.422174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3174-c5a0-4d78-ac38-2e60a7590b5b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.435207 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.457861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.458474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.458756 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.459031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.459856 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:55.460446 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.461868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.471270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 191/384] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:55.471982 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.507271 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.514724 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05ed09-dace-4afc-9d7b-8d317fd75b2e None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.550772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.551768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.552249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.552708 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.565081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.566951 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.581747 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfbc7-ae9f-4f8e-84df-5499d3fc2a73 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:55.585700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:55.586538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:55.587453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:55.587453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.587453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:55.589223 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 194/385] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:55.590250 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.621734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.622341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.622613 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.623389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.624018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:55.624450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.625694 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.642161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 192/386] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:55.642161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.682598 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.705783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac9dd6-425c-448f-b266-f33eca71290c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.736928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.739220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.740134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.740408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.745604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df77c61-682a-41d8-9c90-790aea6ded58 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.753538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.754990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:55.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:55.770011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:55.771015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:55.771015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.771015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:55.771015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 195/387] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:55.771015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.781733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.782364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.782647 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.782922 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.793544 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.795618 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:55.810349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:55.812154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:55.813228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:55.813228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:55.813228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:55.813228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 193/388] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:55.813228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.876589 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0d80-1460-49c7-95a0-babe788065e4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.903394 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:55.909249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.909851 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.910130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.910399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.911032 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:55.911330 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.912762 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba9dff-1616-415e-87b4-8dc4ff5004d4 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:55.912965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.925034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 196/389] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:55.925817 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.953253 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:55.953883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:55.954158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:55.954429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:55.961333 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:55.962761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:23:55.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:55.976052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 194/390] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:55.976975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:55.984430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.030874 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c1ff-baeb-41b2-bbaa-ad7faeca97fc None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.066756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.067316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.067595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.067871 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.077713 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.079137 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.080380 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab54f4-6217-47a9-a69a-12b5e6f480a3 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:56.095593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:56.096594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:56.097791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:56.097791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:56.097791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:56.097791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 197/391] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:56.097791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.116281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.117202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.117478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.118114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:56.118420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.119775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.131725 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 195/392] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:56.132511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.145097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.194621 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.202447 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f871dc1-344d-471f-9202-959e0724b8ff None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.232918 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e773d1-7bfd-481c-ae3e-ba3adeee4ebe None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.235029 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.235673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.235956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.236229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.236896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:56.237202 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.238738 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.251547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 198/393] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:56.252368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.270760 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.271044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.271319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.277867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.279335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:23:56.290840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:56.291656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:56.292771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 196/394] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:56.293433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.351023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efebf20-0526-4487-95aa-1747e2749e82 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.352448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.386041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.386636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.387034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.387307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.388023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:56.388324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.390368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.391337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75b8e6-f894-4931-903b-a5b4c5abaf72 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.414049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.424820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.425443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.425727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.426005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.426240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 199/395] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:56.426643 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:56.426947 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.427044 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.428327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.446893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 197/396] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:56.446893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.530656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46cadf-6387-4726-9d9a-462c50a4e5db None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.539433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21dab-043c-49b5-937b-f96c713cbf2f None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.564602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.565252 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.565527 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.565797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.573506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.574717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.574948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.575335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.575618 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.575968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.583759 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.585201 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:23:56.587542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:56.588603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 200/397] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:56.589629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:23:56.596730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:56.597723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:56.598595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 198/398] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:56.599123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.615439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.648144 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.693394 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a32df-6c4f-4f4f-ba19-427c2a3c7d61 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fc7ad-c3e7-4d39-ace2-320b13b47d55 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.726689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.727294 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.727576 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.727850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.728536 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:56.728869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.730295 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.737728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.738338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.738615 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.738883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.747799 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 201/399] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:56.749174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.750134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.751560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:56.766059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:56.767122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:56.768285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:56.768285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:56.768285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:56.768285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 199/400] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:56.768285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.833366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.853133 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24bbb8-4846-4e82-bb5c-dd4a510770f4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.862944 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:56.869012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1c9fd-4c18-4029-acce-23cbbed75d27 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:56.890704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.891311 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.891596 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.891872 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.892515 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.893985 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.902351 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:56.902945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:56.903223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:56.903494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:56.904210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:56.904508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:56.905935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:56.914744 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 202/401] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:23:56 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:23:56.915560 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:56.924409 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 200/402] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:56.925664 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.047702 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b107a2a-59ea-400a-bf34-a495c6d6768d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.053267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971063c-ea3c-4345-8464-f16e5fff3f64 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.090062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.090531 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.090969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.091167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.091403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.092042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.092328 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.092921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:57.093008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/a7e3cacb07c94c508868cff854dae659/roles/4a5095badf5d4f6d9ef9d87f26f043eb` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.093340 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.094845 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.100128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:57.111191 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=a7e3cacb07c94c508868cff854dae659, role_id=4a5095badf5d4f6d9ef9d87f26f043eb)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.112809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.120037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 203/403] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 19 00:23:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:57.120863 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.128150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 201/404] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:56 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/a7e3cacb07c94c508868cff854dae659/roles/4a5095badf5d4f6d9ef9d87f26f043eb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:57.129817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.143006 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:57.244793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f28b-3b63-458d-af0b-8769b5c68562 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.277200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa31e-ab18-45f1-9869-d089dcf52ebf None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.285417 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.286487 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.287215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.287686 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.288546 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:57.289191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.290815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.304569 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 204/405] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:57.305786 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.322433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.322777 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.323012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.323282 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.338875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.340876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:57.358235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:57.359153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:57.359982 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:57.359982 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:57.359982 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:57.359982 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 202/406] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:57.360636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.375865 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:57.432572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:57.436567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a66d89-87b7-4633-ae9d-68b18ed7b513 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.475333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.476165 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.476568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.476992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.491384 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.493670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.502311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b05ed-e275-4e04-80b8-44de1e484dd4 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:23:57.509334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:57.510382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:23:57.511411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:23:57.511411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:23:57.511411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:57.512786 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 205/407] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:57.514132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.550549 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.551545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.552732 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.553178 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.562737 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.564535 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:23:57.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:57.581974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:57.582985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:57.585701 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 203/408] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:57.586633 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.632887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17e900-d08c-485f-9fe2-302452bdcdf7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.644597 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:57.697598 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.698480 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.698901 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.699326 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.700159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:57.700611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.702946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.713803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e60c17-235e-4705-ba37-8c3a02e1fcc7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.715243 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 206/409] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:57.716315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.731748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:57.753316 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.753969 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.755083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.755083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.755517 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:57.755919 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.757464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.771666 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:57.772664 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.846069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807cfce-9004-48da-934e-a05e050d8a2d None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.890746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee41c-2aba-4435-b102-f1e3a4fb823a None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:57.895615 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.896413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.896879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.897293 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.898130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:57.898769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.901019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.919208 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 207/411] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:57.920355 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:57.941514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:57.942386 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:57.942760 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:57.943122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:57.957249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:57.959039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:57.966236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:23:57.978975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:57.980050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:57.981093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:23:57.986480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 205/412] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:57.988361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:58.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:58.069222 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b5b5-8972-44c6-8996-3f176dd0a695 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:58.121757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:58.122577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:58.123290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:58.123674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:58.133064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:58.134801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:58.144042 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270080d-e45b-4724-8795-9de4296c6294 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:23:58.150669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:23:58.151478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:23:58.152309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 208/413] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:23:58.153108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:58.195774 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:58.196932 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:58.197388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:58.197909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/0448c6383cd142b68d1962842eeb1623/roles/4a5095badf5d4f6d9ef9d87f26f043eb` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:58.217899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=0448c6383cd142b68d1962842eeb1623, role_id=4a5095badf5d4f6d9ef9d87f26f043eb)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:58.220274 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:58.238437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 206/414] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:57 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/0448c6383cd142b68d1962842eeb1623/roles/4a5095badf5d4f6d9ef9d87f26f043eb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:58.239605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:58.271403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:58.289488 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe337f-dccc-4967-81ab-6e391b83ef08 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:58.343004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:58.343850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:58.344232 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:58.344606 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:58.345482 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:58.346575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:58.348271 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:58.357287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:58.371260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 209/415] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:58.382431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:58.390124 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1916a-ca6f-4118-a4f8-566c25ba9f83 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:58.482732 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:58.483596 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:58.484024 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:58.484474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:58.485745 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:23:58.486068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:58.493131 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:58.513257 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 207/416] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:23:58.519575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:58.585275 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7827d-3dde-42bb-a8e5-be5fc81114dc None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:58.649939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6497c28-e383-4d6a-a20a-a9ffb7f2521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:58.650605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497c28-e383-4d6a-a20a-a9ffb7f2521c None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:58.650882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497c28-e383-4d6a-a20a-a9ffb7f2521c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:58.651152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497c28-e383-4d6a-a20a-a9ffb7f2521c None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/21e611c23e574338821093a7cd4a26be/roles/4a5095badf5d4f6d9ef9d87f26f043eb` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:58.668383 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f6bf-f735-44de-9967-40c299a21c33 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:58.682422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6497c28-e383-4d6a-a20a-a9ffb7f2521c None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=21e611c23e574338821093a7cd4a26be, role_id=4a5095badf5d4f6d9ef9d87f26f043eb)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:58.683881 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6497c28-e383-4d6a-a20a-a9ffb7f2521c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:58.690153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:58.707885 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 210/417] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:58 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/21e611c23e574338821093a7cd4a26be/roles/4a5095badf5d4f6d9ef9d87f26f043eb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:58.730718 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d7cbc-c16f-4bd2-af22-73c408d35654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:58.731404 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d7cbc-c16f-4bd2-af22-73c408d35654 None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:58.731729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d7cbc-c16f-4bd2-af22-73c408d35654 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:58.732009 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d7cbc-c16f-4bd2-af22-73c408d35654 None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/eb62183c29e74f75a580306cf6cfae56/roles/4a5095badf5d4f6d9ef9d87f26f043eb` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:58.758426 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d7cbc-c16f-4bd2-af22-73c408d35654 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=eb62183c29e74f75a580306cf6cfae56, role_id=4a5095badf5d4f6d9ef9d87f26f043eb)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:23:58.759812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d7cbc-c16f-4bd2-af22-73c408d35654 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:23:58.766607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:23:58.785917 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 208/418] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:23:58 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/eb62183c29e74f75a580306cf6cfae56/roles/4a5095badf5d4f6d9ef9d87f26f043eb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:23:59.332630 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30d63c-e2f1-4a4a-bb53-98193f9b672b None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:59.333682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30d63c-e2f1-4a4a-bb53-98193f9b672b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:59.334166 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30d63c-e2f1-4a4a-bb53-98193f9b672b None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:59.335953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 211/419] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:59.342085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9ac21-b0a9-438d-a17f-ccb1949830ab None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:59.342548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9ac21-b0a9-438d-a17f-ccb1949830ab None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:59.342811 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9ac21-b0a9-438d-a17f-ccb1949830ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:59.369902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-d7c9ac21-b0a9-438d-a17f-ccb1949830ab None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:59.371158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-d7c9ac21-b0a9-438d-a17f-ccb1949830ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:59.462825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 209/420] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:59.562543 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4627ea-ce22-4294-a75a-652dfd185762 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:59.563173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4627ea-ce22-4294-a75a-652dfd185762 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:59.563996 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4627ea-ce22-4294-a75a-652dfd185762 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:59.565816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 212/421] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:23:59.570745 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39138-301f-4f7e-9438-913c2d635405 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:59.571031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39138-301f-4f7e-9438-913c2d635405 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:59.572452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39138-301f-4f7e-9438-913c2d635405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:59.595289 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-c0f39138-301f-4f7e-9438-913c2d635405 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:23:59.596396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-c0f39138-301f-4f7e-9438-913c2d635405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:23:59.666624 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 210/422] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:23:59.793107 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4627ea-ce22-4294-a75a-652dfd185762 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:23:59.929919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4627ea-ce22-4294-a75a-652dfd185762 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:23:59.977950 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:23:59.978594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:23:59.978875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:23:59.979148 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:23:59.992932 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:23:59.998504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:23:59.999374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:00.000153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 213/423] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:23:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:00.008491 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.008645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39138-301f-4f7e-9438-913c2d635405 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.070845 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:00.113214 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:00.117620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39138-301f-4f7e-9438-913c2d635405 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.154876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.155484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.155760 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.156030 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.156691 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:00.157019 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:00.158397 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:00.167243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 211/424] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:00.173095 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.207271 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9288-7ba0-4518-ac48-45397ca875d1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.276128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18ea4b-c77f-4624-9342-68145de1592c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.301240 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:00.301699 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.302818 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.303203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.303580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.312461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.313123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.313405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.313683 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.326518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:00.328506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:00.329314 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:00.334398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:00.335779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:00.336556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 214/425] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:00.344374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:00.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:00.347085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:00.348928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:00.348928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:00.348928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:00.351860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 212/426] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:00.352047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.478824 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f696-0e64-4db9-b18d-50b0b7930cd4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.521216 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:00.539584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b074d-1250-4e30-89a4-3dad25bd981e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.569553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.570182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.570494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.570779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.571480 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] RBAC: Adding query filter params (name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:00.571788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:00.573321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:00.575461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.576351 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.576823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.577273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.578100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:00.578572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:00.580112 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:00.598767 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 215/428] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:00.599072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 213/428] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:00.601780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.601901 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.637261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:00.706746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd3c26-6949-45f6-8231-52a482b39183 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.744184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.745122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.745635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.746085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.754845 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:00.756628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:00.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:00.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:00.771301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:00.773488 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 214/429] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:00.779438 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.869066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2461be-370b-4d94-8c64-2cb0c9e5ca21 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.883867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:00.896073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963dc59-f255-4f45-90be-5cd560199dd8 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:00.936652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.937861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.938398 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.938848 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.940086 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:00.940556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:00.942199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:00.961551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:00.961954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 215/430] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:00.962200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:00.962477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:00.962756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:00.967772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:00.991467 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:00.993342 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:01.025861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:01.026796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:01.027632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:01.027632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:01.027632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:01.035180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 216/431] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:01.041123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.105228 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:01.154584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f5505-a536-4641-8adb-565aa82740d7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.183764 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2fff-ba04-4576-9b6b-9e3b63b3d824 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.197089 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32894be-a383-465b-ab7a-927e3803f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.197728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32894be-a383-465b-ab7a-927e3803f646 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.198012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32894be-a383-465b-ab7a-927e3803f646 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.198288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32894be-a383-465b-ab7a-927e3803f646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.210784 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32894be-a383-465b-ab7a-927e3803f646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:01.212234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32894be-a383-465b-ab7a-927e3803f646 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:01.222696 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.223231 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:01.223808 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.224278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.224737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.225613 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:01.226108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:01.227620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-d32894be-a383-465b-ab7a-927e3803f646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:01.231335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:01.232815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:01.233679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:01.233679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:01.233679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:01.237548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 216/432] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:01.237548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d7025-5202-429f-8ba0-bbea9ae89665 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.237548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d7025-5202-429f-8ba0-bbea9ae89665 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.237548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d7025-5202-429f-8ba0-bbea9ae89665 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.237548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 217/433] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:01.242935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce67a-5e96-49d0-91bb-ddb5709ed9ea None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.243222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce67a-5e96-49d0-91bb-ddb5709ed9ea None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.243496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce67a-5e96-49d0-91bb-ddb5709ed9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.250060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 217/434] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:01.251275 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.264256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-5abce67a-5e96-49d0-91bb-ddb5709ed9ea None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:01.265499 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-5abce67a-5e96-49d0-91bb-ddb5709ed9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:01.350912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:01.353937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 218/435] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:24:01.354841 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abce67a-5e96-49d0-91bb-ddb5709ed9ea None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.364491 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30711a-dd2c-46a3-8ff6-9c2669e90c77 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.427859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eef69d-6e0a-464f-b7e5-273354ee3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.428470 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef69d-6e0a-464f-b7e5-273354ee3a88 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.428787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef69d-6e0a-464f-b7e5-273354ee3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.429090 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef69d-6e0a-464f-b7e5-273354ee3a88 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.429734 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eef69d-6e0a-464f-b7e5-273354ee3a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:01.430037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eef69d-6e0a-464f-b7e5-273354ee3a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:01.431453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eef69d-6e0a-464f-b7e5-273354ee3a88 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:01.449743 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 218/436] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:01.449743 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3d43-25ce-4140-a888-b9790ea0843c None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.449743 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3d43-25ce-4140-a888-b9790ea0843c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.449743 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3d43-25ce-4140-a888-b9790ea0843c None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.453789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 219/437] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:01.454944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab357aea-6ce5-49fa-9547-41720b44e553 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.455222 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab357aea-6ce5-49fa-9547-41720b44e553 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.455490 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab357aea-6ce5-49fa-9547-41720b44e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.473617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-ab357aea-6ce5-49fa-9547-41720b44e553 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:01.474749 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-ab357aea-6ce5-49fa-9547-41720b44e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:01.505190 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abce67a-5e96-49d0-91bb-ddb5709ed9ea None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.540261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:01.548121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005356ee-948a-4319-9325-ab41013be152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.548757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005356ee-948a-4319-9325-ab41013be152 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.549062 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005356ee-948a-4319-9325-ab41013be152 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.549338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005356ee-948a-4319-9325-ab41013be152 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.558720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005356ee-948a-4319-9325-ab41013be152 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:01.561162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005356ee-948a-4319-9325-ab41013be152 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:01.572667 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 220/438] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:01.573999 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab357aea-6ce5-49fa-9547-41720b44e553 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-005356ee-948a-4319-9325-ab41013be152 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:01.583477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:01.584476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:01.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:01.592704 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 219/439] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:01.602063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005356ee-948a-4319-9325-ab41013be152 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.703368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:01.729841 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab357aea-6ce5-49fa-9547-41720b44e553 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.752533 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005356ee-948a-4319-9325-ab41013be152 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.782841 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.783748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.784206 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.784654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.795185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:01.797711 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:01.808518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ac88-4aaa-41da-971f-055b5051ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.809480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ac88-4aaa-41da-971f-055b5051ebaf None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ac88-4aaa-41da-971f-055b5051ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.810903 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ac88-4aaa-41da-971f-055b5051ebaf None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.812130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ac88-4aaa-41da-971f-055b5051ebaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:01.812642 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ac88-4aaa-41da-971f-055b5051ebaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:01.815090 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ac88-4aaa-41da-971f-055b5051ebaf None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:01.816427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:01.817484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:01.818290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 221/440] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:01.819262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.839061 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 220/441] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:01.840349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd752862-f122-47e5-98eb-f928ae5e9b6b None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.840636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd752862-f122-47e5-98eb-f928ae5e9b6b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.840943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd752862-f122-47e5-98eb-f928ae5e9b6b None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.843137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 221/442] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:01.844182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd752862-f122-47e5-98eb-f928ae5e9b6b None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.897410 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:01.926979 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42890e1-7f64-4c2d-92a3-328cc7b4dad3 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.949274 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd752862-f122-47e5-98eb-f928ae5e9b6b None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:01.960189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.960814 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.961121 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.961390 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.969418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:01.974182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:01.978926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:01.979816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:01.980587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 222/443] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:01.981268 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:01.989157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac86a0-3ba2-4a89-a345-9ad206780c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:01.989779 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac86a0-3ba2-4a89-a345-9ad206780c9e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:01.990060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac86a0-3ba2-4a89-a345-9ad206780c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:01.990334 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac86a0-3ba2-4a89-a345-9ad206780c9e None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:01.991478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac86a0-3ba2-4a89-a345-9ad206780c9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:01.991789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac86a0-3ba2-4a89-a345-9ad206780c9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:01.993655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac86a0-3ba2-4a89-a345-9ad206780c9e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.005625 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 222/444] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:02.006780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f496f-246e-4964-b842-e6ac9042badc None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.007068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f496f-246e-4964-b842-e6ac9042badc None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.007348 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f496f-246e-4964-b842-e6ac9042badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.025061 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-6f8f496f-246e-4964-b842-e6ac9042badc None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:02.026259 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6f8f496f-246e-4964-b842-e6ac9042badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:02.084797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0c051-5c92-4955-9970-34c7a5bde502 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.092147 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 223/445] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:02.092990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f496f-246e-4964-b842-e6ac9042badc None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.117722 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.118324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.118605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.118878 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.137038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.187475 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.189875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:02.191355 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.206088 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f496f-246e-4964-b842-e6ac9042badc None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.242325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.242960 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.243239 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.243511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.255188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:02.259942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:02.260815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 224/446] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:02.262269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.304769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 223/447] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:24:02.309744 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.363284 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.367405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e18f-69a2-4df8-be8d-269581daae6a None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.402837 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.403427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.403710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.404001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.404649 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:02.404983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:02.406326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.409736 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.413303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781afc2-f09f-4f86-87bf-7bbcaf2564d7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.414897 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 225/448] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:02.415524 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.447730 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.448325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.448613 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.448920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/1aa883a98a0343d2be532c739910fb13/roles/4a5095badf5d4f6d9ef9d87f26f043eb` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.463768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=1aa883a98a0343d2be532c739910fb13, role_id=4a5095badf5d4f6d9ef9d87f26f043eb)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:02.465234 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.477667 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 224/449] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:24:02 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/1aa883a98a0343d2be532c739910fb13/roles/4a5095badf5d4f6d9ef9d87f26f043eb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:24:02.478463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.525590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b42e2-42a7-4810-8874-2e4604810013 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.570122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.570764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.571618 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:02.571923 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:02.574343 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.590264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 226/450] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:02.590264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.617954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac8f8-dce0-4c56-a316-b7b5916f656d None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.668709 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.669424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.670289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.670555 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.680776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:02.682246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:02.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:02.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:02.701921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:02.701921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:02.701921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:02.703708 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 225/451] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:02.704677 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.707307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.713215 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c37c0f-a6c4-42ff-a167-080221c5f3a0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.750946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.751936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.752225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.752787 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.764743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:02.769965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:02.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:02.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 227/452] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:02.772259 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.818938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b02116-abeb-42df-81e5-862ab27e02d3 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.853803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.854428 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.854705 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.854977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.864543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.867073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:02.868518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.883476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14964-618b-4a75-bfb9-89ddcf0b0402 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:02.883619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:02.884469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:02.885349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:02.885349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:02.885349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:02.889339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 226/453] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:02.890188 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:02.920899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:02.921527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:02.921805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:02.922075 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:02.940125 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:02.941602 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:02.950901 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:02.958420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:02.959305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:02.960152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:02.960152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:02.960152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:02.960152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 228/454] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:02.960859 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.003388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c981d0-267d-46d2-9321-b73b4a0b2638 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.038592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.039198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.039479 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.039752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.040388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:03.040691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.042086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.056880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 227/455] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:03.056880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.074811 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b74da-71a3-4525-acbd-59f1f1e52036 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.112761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.113419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.113696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.113973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.114634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:03.114937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.116319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.117840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.131087 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 229/456] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:03.131999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.163993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0c071-27c6-43ce-9e44-4245efa94aba None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.182685 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.212864 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.213391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.213669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.213939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.214584 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:03.215397 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.217630 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.235258 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 228/457] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:03.236218 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.244977 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93aba1-2146-4b57-9ceb-51a917326b50 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.282233 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.283254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.283754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.284128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.284776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:03.285224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.286965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.304109 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 230/458] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:03.304109 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.338648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812eb0-1b93-4396-a9f1-7be63fbb542f None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.367600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.375918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.376546 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.376843 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.377131 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.384291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.385768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:03.397283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:03.398111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:03.398945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 229/459] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:03.400122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.419279 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56a7e-107a-4e27-86a8-0cfad0d0e6b7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.435780 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.455694 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.456326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.456606 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.457219 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.470422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:03.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:03.487775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:03.488620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:03.488620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:03.488620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:03.488620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 231/460] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:03.488876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.507282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc1bf-099d-4fa4-8253-2e45ddead632 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.540980 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.541601 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.541879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.542147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.549197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.550638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:03.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:03.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:03.564411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 230/461] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:03.564991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.606342 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27404fc4-3246-4437-8144-00d34cc52a32 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.618249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.651327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.651958 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.652239 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.652676 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.661516 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.663300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.666204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.673383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6067b-09dc-4aed-b06e-1121af6f94d1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:03.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:03.676278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:03.677223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 232/462] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:03.679122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.714598 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.715213 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.715497 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.715775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.716531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:03.716876 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.718295 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.731013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 231/463] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:03.731748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.798350 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06290703-4435-418d-9ea4-52afaa037172 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.834706 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.835307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.835854 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.836492 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:03.836793 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.837691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48a68-527b-4f5e-a947-3f3207e37782 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:03.838211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.850500 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 233/464] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:03.851288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.878941 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:03.879548 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:03.879826 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:03.880098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:03.880812 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:03.881144 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:03.882549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:03.883470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.901525 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 232/465] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:03.902610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:03.917265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:03.976210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32227e-2252-4706-baf2-76525f8ebe6e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.015897 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428ccf0-9cc6-40d7-9c0f-0c902df165b0 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.018583 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.019201 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.019485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.019763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.020491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:04.020800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.022300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.046326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 234/466] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:04.046326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:04.056424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.057309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.057309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.057596 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.058318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] RBAC: Adding query filter params (role.id=4a5095badf5d4f6d9ef9d87f26f043eb, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=a7e3cacb07c94c508868cff854dae659) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:04.058628 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.060066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.066507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 233/467] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:03 2022] GET /identity/v3/role_assignments?user.id=a7e3cacb07c94c508868cff854dae659&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=4a5095badf5d4f6d9ef9d87f26f043eb => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:04.067279 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:04.150778 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:04.170644 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341480-d07b-4bec-b46f-244c61a6eba9 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.192705 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:04.212321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.213185 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.213563 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.213935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.224916 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.226734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.229242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9d50b-043f-443b-a2d7-ffc2ce52aa58 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:04.240474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:04.241674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 00:24:04.242654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:04.247222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 235/468] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:04.248918 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:04.280767 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.281557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.281851 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.282194 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.376028 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0d32-deb2-427b-84df-983bb8646137 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.377443 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.380403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.423501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.424116 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.424398 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.424673 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.445447 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:04.489095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:04.510244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.512294 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.521320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 234/469] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:24:04.523108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:04.639753 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 236/470] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:24:04.640668 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:04.655276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641dd0-2744-4bdc-b558-80391ab57b44 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.693371 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:04.697206 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4764-0ca9-4d3e-9464-d22688681e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.699043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4764-0ca9-4d3e-9464-d22688681e0b None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.699505 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4764-0ca9-4d3e-9464-d22688681e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.699968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4764-0ca9-4d3e-9464-d22688681e0b None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.701994 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4764-0ca9-4d3e-9464-d22688681e0b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:04.702492 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4764-0ca9-4d3e-9464-d22688681e0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.704627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4764-0ca9-4d3e-9464-d22688681e0b None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.731801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 235/471] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 19 00:24:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:04.731801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8a72-6c97-406b-8ec8-fc142eb5e6b2 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.731801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8a72-6c97-406b-8ec8-fc142eb5e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.731801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8a72-6c97-406b-8ec8-fc142eb5e6b2 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.731801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 236/472] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:04.731801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8a72-6c97-406b-8ec8-fc142eb5e6b2 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:04.758944 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98fcf-e8dd-41eb-ad6c-68d6b1de9b66 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.767905 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:04.796605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.797268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.797546 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.797811 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.808109 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.809607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:04.826292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:04.827301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:04.828114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:04.828114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:04.828114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:04.828114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 237/473] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:04.828742 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:04.839810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8a72-6c97-406b-8ec8-fc142eb5e6b2 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.878807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf501935-9f95-4338-9fab-d40411fa8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.879440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf501935-9f95-4338-9fab-d40411fa8662 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.879720 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf501935-9f95-4338-9fab-d40411fa8662 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.880387 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf501935-9f95-4338-9fab-d40411fa8662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.892402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf501935-9f95-4338-9fab-d40411fa8662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:04.893809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf501935-9f95-4338-9fab-d40411fa8662 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-bf501935-9f95-4338-9fab-d40411fa8662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:04.909575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:04.910495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:04.911315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:04.911315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:04.911315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:04.911315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 237/474] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:04.912139 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9439-a323-44e5-a04b-9c8fd5f4a3a8 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:04.912425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9439-a323-44e5-a04b-9c8fd5f4a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:04.912699 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db9439-a323-44e5-a04b-9c8fd5f4a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:04.930609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-a3db9439-a323-44e5-a04b-9c8fd5f4a3a8 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:04.931810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-a3db9439-a323-44e5-a04b-9c8fd5f4a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:04.954910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:04.959276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98ed9-909f-4af5-bf82-875258824c86 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:04.999093 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:04.999790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.000068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.000341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.005620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 238/475] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:05.006679 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db9439-a323-44e5-a04b-9c8fd5f4a3a8 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.031183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:05.087308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.088904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.150060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db9439-a323-44e5-a04b-9c8fd5f4a3a8 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.189917 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:05.194514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:24:05.195726 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.201458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.202489 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.202978 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.203442 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.204270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:05.204807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.206990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.228965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 239/477] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:05.229949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.310859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:05.326650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70a7a7-de6c-4a8c-9bea-60002c8a2f0e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.335196 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7a64b-8cae-484b-a0b6-874dd4128174 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.363690 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.364232 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.364757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.364757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.365520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:05.365739 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.367091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.372194 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.373467 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.373884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.374163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.379124 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 239/478] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:05.380430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.387991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.390296 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:05.406082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:05.406972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:05.407797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:05.407797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:05.407797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:05.407797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:05.408005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.448907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:05.500046 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6b05-f318-4b34-be9b-3f957d934ac7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.523676 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b9800-5120-443f-b966-eafea2ebc32f None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.533765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.534399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.534683 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.534956 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.543101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.545141 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.551972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:05.560776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:05.561905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:05.562715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:05.563095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.563095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.563095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.563095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.563451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:05.563451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.579595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:05.584967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:05.585807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:05.586573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 241/481] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:05.587202 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.675571 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a364307-158c-4009-b711-37e9b38c412a None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.694759 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e475-1b1f-4230-9de3-b2ba20ef8c7b None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.694926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:05.715577 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.716721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.717317 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.717772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.725829 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.727474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.728246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.728867 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.729150 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.729421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.730056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:05.730356 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.731699 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:05.739847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:05.740707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 241/482] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:05.747031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.756791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 242/483] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:05.756791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.808457 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:05.862325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b4f7-08c4-447d-8dbe-b86cdac22325 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.862757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c918a-75a8-4387-b47e-ed2718c5efc8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:05.897948 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.898665 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:05.898775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.899167 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.899262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:05.899532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:05.899684 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.899803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:05.900462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:05.900629 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:05.900760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.901145 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:05.902138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.902748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:05.915367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 243/484] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:05.915367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.922043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 242/485] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:05.923027 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:05.973569 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:06.030035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d068-bfe8-49dd-b683-848f7b14ae79 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.040541 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:06.044861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a236-cbd6-444f-bb45-0a1f8566a2ea None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.066968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.067579 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.067862 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.068137 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.069125 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:06.069543 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.070990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.080550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.081215 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.081545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.081823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.088740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.090211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.091396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 244/486] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:06.092270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:06.102276 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:06.103098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:06.103955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 243/487] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:06.104405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.199130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd407094-b6ab-4252-ae28-58804c1d7a94 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.206727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:06.212746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e4478-3c8b-4e16-9882-b29b6a594821 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.238915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.239933 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.240413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.240687 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.254291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.254291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.254622 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.254823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.255560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] RBAC: Adding query filter params (role.id=4a5095badf5d4f6d9ef9d87f26f043eb, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=0448c6383cd142b68d1962842eeb1623) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:06.255867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.257422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.258059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.259734 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.272879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/role_assignments?user.id=0448c6383cd142b68d1962842eeb1623&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=4a5095badf5d4f6d9ef9d87f26f043eb => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:06.272879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:06.277755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:06.278682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:06.280026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:06.280026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:06.280026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:06.280026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 245/489] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:06.280026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.307236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:06.400194 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9d8b4-71d9-4140-9faf-be483a7e7f90 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.406053 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7fab3-0315-47ca-a645-b3fbc9c27027 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.438038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6c4c0-1acd-4477-8a5c-f999deebd6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.438660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c4c0-1acd-4477-8a5c-f999deebd6bd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.438937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c4c0-1acd-4477-8a5c-f999deebd6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.439207 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c4c0-1acd-4477-8a5c-f999deebd6bd None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.439903 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6c4c0-1acd-4477-8a5c-f999deebd6bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:06.440211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6c4c0-1acd-4477-8a5c-f999deebd6bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.441694 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6c4c0-1acd-4477-8a5c-f999deebd6bd None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.444406 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.445058 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.445342 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.445619 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.446355 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] RBAC: Adding query filter params (role.id=4a5095badf5d4f6d9ef9d87f26f043eb, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=21e611c23e574338821093a7cd4a26be) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:06.446670 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.448117 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.456377 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/role_assignments?user.id=21e611c23e574338821093a7cd4a26be&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=4a5095badf5d4f6d9ef9d87f26f043eb => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:06.456542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 246/491] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:06.457079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.457234 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8bea-6539-4e4c-a10d-8bfad06adc95 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.457345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8bea-6539-4e4c-a10d-8bfad06adc95 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.457614 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8bea-6539-4e4c-a10d-8bfad06adc95 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.458934 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 247/492] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:06.464073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f7e1-fda4-4d96-8eb0-6c01e35ed09a None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.464365 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f7e1-fda4-4d96-8eb0-6c01e35ed09a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.464624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f7e1-fda4-4d96-8eb0-6c01e35ed09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.488867 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-2544f7e1-fda4-4d96-8eb0-6c01e35ed09a None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:06.488867 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2544f7e1-fda4-4d96-8eb0-6c01e35ed09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:06.495557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:06.569079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 248/493] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:24:06.569967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544f7e1-fda4-4d96-8eb0-6c01e35ed09a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.596163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:06.619249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebd3fe-3d58-4d54-a561-01ee4a37321b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.687038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.688171 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.688547 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.688968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.689708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:06.690198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.691656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.705510 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 246/494] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:06.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544f7e1-fda4-4d96-8eb0-6c01e35ed09a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.711106 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.751125 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.752069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.752414 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.752750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.753572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] RBAC: Adding query filter params (role.id=4a5095badf5d4f6d9ef9d87f26f043eb, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=eb62183c29e74f75a580306cf6cfae56) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:06.753948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.755868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.762249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 249/495] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/role_assignments?user.id=eb62183c29e74f75a580306cf6cfae56&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=4a5095badf5d4f6d9ef9d87f26f043eb => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:06.813633 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:06.830809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77640e85-742d-4c55-9bb2-a69566dd9f25 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:06.870343 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:06.871072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:06.871357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:06.871638 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:06.880060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:06.880922 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.881669 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:06.897724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:06.898671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:06.899721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 247/496] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:06.906638 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:06.988634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:07.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67efca-199c-4fe6-ab4a-c38c1f3c4d30 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:07.049822 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee32e5-0562-46b0-9906-f10b9f39467a None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:07.055060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:07.055693 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:07.055976 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:07.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:07.068385 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:07.074241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:07.075369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:07.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 250/497] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:07.083122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:07.103509 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:07.104566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:07.104974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:07.105750 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:07.106636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:07.107582 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:07.109770 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:07.133231 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 248/498] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 00:24:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:07.140261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:07.161209 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:07.259892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fed0e2-a032-42b8-a64f-44f81ed19239 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:07.323108 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306d927-84a9-4632-82a7-c658212c63ac None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:07.328949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:07.329901 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:07.330399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:07.330853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:07.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:07.332227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:07.333878 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:07.345189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:07.357773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 251/499] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:07.370091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:07.397697 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:07.398316 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:07.398601 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:07.398874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:07.520185 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:07.521576 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:07.524790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:07.559593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31766-f9f5-41c1-8e02-9ee6008c79b5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:07.636759 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:07.637411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:07.637690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:07.637968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:07.655799 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 249/500] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 00:24:07.661297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:07.664377 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:07.667650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:07.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:07.695776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:07.696728 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:07.696728 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:07.696728 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:07.696922 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 252/501] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:07.721887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:07.790077 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce6bd-da26-4d16-81cc-9ef4dd6c569b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:07.792744 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:07.834227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:07.835222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:07.835677 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:07.836122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:07.845225 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:07.858719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:07.860188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:07.888968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:07.889952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:07.890885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:07.890885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:07.890885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:07.890885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 250/502] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:07.897766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:07.926521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0400ca-7896-4daa-ae44-9a4d7ec6bab0 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:07.975504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:07.976165 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:07.976438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:07.976703 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:07.983124 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:07.983437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:07.984809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.011991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 253/503] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:08.033381 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:08.061494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5c2b-d568-40e6-a003-0c2094974c67 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:08.098309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:08.098923 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.099204 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.099480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.100127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:08.100434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:08.105866 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.130904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 251/504] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:08.136588 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:08.169217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:08.227257 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf3782-2540-41de-b340-930c188d9aa9 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:08.255171 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:08.301145 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:08.301777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.302055 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.302322 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.315913 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:08.317308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:08.334940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:08.335971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:08.336899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:08.340936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 254/505] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 00:24:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:08.344049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:08.345803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3272e-277b-4060-94e6-72e0b31a8eb6 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:08.408643 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:08.409294 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.409572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.409842 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.422202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:08.423640 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:08.443674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:08.444605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:08.445497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:08.447283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 252/506] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:08.452708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:08.501608 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0babd6d-8c9d-48ba-8227-f446e8e5b1ec None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:08.538026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:08.538632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.538909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.539176 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.539894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:08.540196 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:08.541830 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.562048 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 255/507] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 00:24:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:08.571709 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:08.604859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:08.676421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00d014-4c40-4200-9994-0a7a189d7f0d None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:08.699610 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:08.713615 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:08.714612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.714895 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.715166 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.727056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:08.728586 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:08.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:08.745900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:08.746748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:08.746748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:08.746748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:08.746748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 256/508] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:08.753350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:08.790927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b4014-9e09-4471-9e59-ea8e742e1bd3 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:08.867690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:08.877409 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1be25-c0e8-40b6-b74c-bf31e33ccb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:08.878026 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1be25-c0e8-40b6-b74c-bf31e33ccb81 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.878309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1be25-c0e8-40b6-b74c-bf31e33ccb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.878639 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1be25-c0e8-40b6-b74c-bf31e33ccb81 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.879337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1be25-c0e8-40b6-b74c-bf31e33ccb81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:08.879861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1be25-c0e8-40b6-b74c-bf31e33ccb81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:08.883543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1be25-c0e8-40b6-b74c-bf31e33ccb81 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.894955 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade892-ad6c-488d-bfb0-713c28e82ffa None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:08.908249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 253/509] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:08.909546 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828120-74bc-46f4-bf43-bff8b31bd9f7 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.909836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828120-74bc-46f4-bf43-bff8b31bd9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.910113 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828120-74bc-46f4-bf43-bff8b31bd9f7 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.915609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 254/510] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:08.917011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787c6b8-adbb-482a-b028-ff450446f841 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.917291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787c6b8-adbb-482a-b028-ff450446f841 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.917975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787c6b8-adbb-482a-b028-ff450446f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.947566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-d787c6b8-adbb-482a-b028-ff450446f841 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:08.948775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-d787c6b8-adbb-482a-b028-ff450446f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:08.951303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:08.951916 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:08.952199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:08.952472 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:08.953149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:08.953454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:08.954869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:08.967896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 257/511] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:08.968819 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.045285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 255/512] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:09.045285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787c6b8-adbb-482a-b028-ff450446f841 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.113446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f33d8-ceee-4c6b-85fc-5c3dc8f6b4c5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.137806 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:09.177537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787c6b8-adbb-482a-b028-ff450446f841 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.210735 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59c07d-522c-4201-bd52-6ad67d770c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:09.211366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c07d-522c-4201-bd52-6ad67d770c9d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.211992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c07d-522c-4201-bd52-6ad67d770c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.211992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c07d-522c-4201-bd52-6ad67d770c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.212658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c07d-522c-4201-bd52-6ad67d770c9d None admin] RBAC: Adding query filter params (role.id=4a5095badf5d4f6d9ef9d87f26f043eb, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=1aa883a98a0343d2be532c739910fb13) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:09.213011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c07d-522c-4201-bd52-6ad67d770c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:09.214496 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c07d-522c-4201-bd52-6ad67d770c9d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:09.226931 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 258/513] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:08 2022] GET /identity/v3/role_assignments?user.id=1aa883a98a0343d2be532c739910fb13&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=4a5095badf5d4f6d9ef9d87f26f043eb => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:09.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:09.229723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.230224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.230690 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.234062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db699-91a8-4bd0-8aed-c072ea494120 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.234226 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db699-91a8-4bd0-8aed-c072ea494120 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.234516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db699-91a8-4bd0-8aed-c072ea494120 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.235902 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 259/514] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:09.240723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:09.241614 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6a8a-c1e7-4660-bda7-8f0fc2101eb2 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.241899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6a8a-c1e7-4660-bda7-8f0fc2101eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec6a8a-c1e7-4660-bda7-8f0fc2101eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.243163 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:09.257080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:09.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:09.258879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:09.261593 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 256/515] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:09.266914 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.274465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:09.301980 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-e9ec6a8a-c1e7-4660-bda7-8f0fc2101eb2 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:09.303237 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e9ec6a8a-c1e7-4660-bda7-8f0fc2101eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:09.387779 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddda1d-cf33-4c5f-ae4e-edbd01eb683c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.414546 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 260/516] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:24:09.415879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e3939-345b-4409-ace5-6680493c16d1 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.416175 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e3939-345b-4409-ace5-6680493c16d1 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.416455 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e3939-345b-4409-ace5-6680493c16d1 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.417996 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 261/517] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:09.418712 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e3939-345b-4409-ace5-6680493c16d1 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.420778 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:09.433598 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7b9d-97ce-4456-9bde-d5f71a960745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:09.433791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7b9d-97ce-4456-9bde-d5f71a960745 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.434020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7b9d-97ce-4456-9bde-d5f71a960745 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.434217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7b9d-97ce-4456-9bde-d5f71a960745 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.435374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7b9d-97ce-4456-9bde-d5f71a960745 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:09.435374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7b9d-97ce-4456-9bde-d5f71a960745 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:09.436908 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7b9d-97ce-4456-9bde-d5f71a960745 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:09.451038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 257/518] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:09.452619 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb360-9e6f-4d84-a40e-d5e982f08545 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.454066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb360-9e6f-4d84-a40e-d5e982f08545 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.454066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb360-9e6f-4d84-a40e-d5e982f08545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.475800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3e9eb360-9e6f-4d84-a40e-d5e982f08545 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:09.477472 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3e9eb360-9e6f-4d84-a40e-d5e982f08545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:09.552721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 258/519] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:09.553988 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eb360-9e6f-4d84-a40e-d5e982f08545 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.556822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e3939-345b-4409-ace5-6680493c16d1 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.607959 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:09.608590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.608894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.609165 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.609751 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:09.611107 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:09.621700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:09.622757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 262/520] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 19 00:24:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:09.623558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:09.630822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.688556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eb360-9e6f-4d84-a40e-d5e982f08545 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.710736 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:09.736907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:09.738187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.738725 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.739194 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/a7e3cacb07c94c508868cff854dae659/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.739366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421ad4-ef85-4b6e-9f72-159d13c23a4d None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.742965 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=a7e3cacb07c94c508868cff854dae659, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:09.744603 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:09.771894 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 259/521] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:24:09 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/a7e3cacb07c94c508868cff854dae659/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:24:09.790446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:09.791057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.791333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.791603 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.792236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:09.792589 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:09.794040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:09.799800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 263/522] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 00:24:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:09.804952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.806165 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:09.875746 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:09.918368 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3aaff-e844-4c11-ac16-a81a38562920 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.969142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:09.969710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:09.969986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:09.970258 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:09.977943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25f3b-2b33-42e3-9cc7-a9ba7ef3f71e None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:09.983036 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:09.984576 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:10.000853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:10.001843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:10.003323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:10.003323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:10.003323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:10.003323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 260/523] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:10.007772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:10.043158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:10.046182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:10.046811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:10.047090 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:10.047394 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:10.048084 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:10.048675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:10.051390 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:10.062139 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 264/524] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 00:24:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:10.063117 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:10.124044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28b7d3-898f-4ec7-af51-d2dd99e902dc None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:10.160939 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:10.162149 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:10.162624 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:10.163070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:10.163890 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:10.164369 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:10.166063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:10.179122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 261/525] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:10.184922 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:10.275599 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3ef3b-5d95-4496-9a9a-059284ad55f0 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:10.285867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:10.299935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1f39e-1f5b-4891-9d3d-5d6a13880220 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:10.338480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:10.340270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:10.340995 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:10.343520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:10.344438 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:10.347007 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:10.349197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:10.365503 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:10.366157 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:10.366437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:10.366707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] PATH_INFO: `/v3/services/network` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:10.367322 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:10.369910 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:10.384378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:10.385539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:10.386367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 265/526] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:10 2022] GET /identity/v3/services/network => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:10.392750 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 262/527] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:24:10 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:24:10.398134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:10.530548 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412caf00-77c3-42b2-b199-4b5e8a3ba539 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:10.572267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004026d-ff6b-4703-882c-077d6ddcfa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:10.573515 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004026d-ff6b-4703-882c-077d6ddcfa69 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:10.574010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004026d-ff6b-4703-882c-077d6ddcfa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:10.574489 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004026d-ff6b-4703-882c-077d6ddcfa69 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:10.576646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004026d-ff6b-4703-882c-077d6ddcfa69 None admin] RBAC: Adding query filter params (name=network) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:10.577388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004026d-ff6b-4703-882c-077d6ddcfa69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:10.579008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004026d-ff6b-4703-882c-077d6ddcfa69 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:10.584755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 266/528] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:10.590975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:10.707365 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6075b6-55f5-4b2e-b490-3423699d861c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:10.748872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f0863-cd7c-4ebd-9b4e-4399eac3492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:10.749497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0863-cd7c-4ebd-9b4e-4399eac3492c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:10.749782 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0863-cd7c-4ebd-9b4e-4399eac3492c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:10.750059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0863-cd7c-4ebd-9b4e-4399eac3492c None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:10.750708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f0863-cd7c-4ebd-9b4e-4399eac3492c None admin] RBAC: Adding query filter params (type=network) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:10.751013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f0863-cd7c-4ebd-9b4e-4399eac3492c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:10.752386 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f0863-cd7c-4ebd-9b4e-4399eac3492c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:10.759041 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 263/529] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:11.816604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159264a-e4e6-4b42-b31f-36d8a871b818 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:11.817158 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159264a-e4e6-4b42-b31f-36d8a871b818 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:11.817158 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159264a-e4e6-4b42-b31f-36d8a871b818 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:11.818786 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 267/530] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:11.823790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7879c-470c-41ac-9546-baa3369c1cfc None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:11.824175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7879c-470c-41ac-9546-baa3369c1cfc None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:11.824375 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7879c-470c-41ac-9546-baa3369c1cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:11.847323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ddb7879c-470c-41ac-9546-baa3369c1cfc None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:11.848521 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ddb7879c-470c-41ac-9546-baa3369c1cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:11.850538 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:11.951240 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 264/531] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:12.280339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97789-a35b-4f92-891b-76a2a15d3173 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:12.280511 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97789-a35b-4f92-891b-76a2a15d3173 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:12.280791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97789-a35b-4f92-891b-76a2a15d3173 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:12.282378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 268/532] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:12.288218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c988d4-5016-4647-9bef-8e9bce76860c None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:12.288548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c988d4-5016-4647-9bef-8e9bce76860c None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:12.288772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c988d4-5016-4647-9bef-8e9bce76860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:12.312928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-73c988d4-5016-4647-9bef-8e9bce76860c None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:12.314123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-73c988d4-5016-4647-9bef-8e9bce76860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:12.406468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 265/533] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:12.442198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97789-a35b-4f92-891b-76a2a15d3173 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:12.536926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:12.608249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97789-a35b-4f92-891b-76a2a15d3173 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:12.656444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf26082-be65-44a7-b054-14ce31004329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:12.657134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf26082-be65-44a7-b054-14ce31004329 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:12.657410 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf26082-be65-44a7-b054-14ce31004329 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:12.657681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf26082-be65-44a7-b054-14ce31004329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:12.674480 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf26082-be65-44a7-b054-14ce31004329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-aaf26082-be65-44a7-b054-14ce31004329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:12.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:12.680086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:12.680938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 269/534] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:12.688107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c988d4-5016-4647-9bef-8e9bce76860c None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:12.699908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad675cd-52f8-49b7-8d41-5ea9b4c0ba48 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:12.700191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad675cd-52f8-49b7-8d41-5ea9b4c0ba48 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:12.701081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad675cd-52f8-49b7-8d41-5ea9b4c0ba48 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:12.702771 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 270/535] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:24:12.707586 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130231ec-7b6f-41dd-a916-39c294a2f576 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:12.707863 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130231ec-7b6f-41dd-a916-39c294a2f576 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:12.708133 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130231ec-7b6f-41dd-a916-39c294a2f576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:12.734571 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-130231ec-7b6f-41dd-a916-39c294a2f576 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:12.735779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-130231ec-7b6f-41dd-a916-39c294a2f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:12.799142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:12.831674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 271/536] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 00:24:12.832600 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130231ec-7b6f-41dd-a916-39c294a2f576 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:12.844366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c988d4-5016-4647-9bef-8e9bce76860c None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:12.881763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:12.892219 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:12.892980 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:12.893257 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:12.893775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:12.894860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:12.895284 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:12.897065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:12.908585 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 266/537] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:12.915050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:12.963797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130231ec-7b6f-41dd-a916-39c294a2f576 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.027413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.028054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.028335 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.028653 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.035761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f2594-4f78-48d2-bfc7-72374daa8f85 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.045834 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:13.055422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:13.056391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:13.057242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 272/538] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:13.063225 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.114265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:13.130407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.131046 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.131322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.131594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.157877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.159325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.178157 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa59d8-ce8f-4e75-92e9-40e446ab542c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.181636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:13.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:13.192986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:13.195150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:13.195150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:13.195150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:13.195150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 267/539] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:13.203159 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.239453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.240066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.240349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.240669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.241378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:13.241684 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.243655 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.254148 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 273/540] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:13.255204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.338266 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55fd87-fb18-404d-bb6b-ff748922e3de None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.369543 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ce2c4-036f-45d1-8b86-d26e225009ba None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.377498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.378112 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.378391 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.378663 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.379646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:13.379950 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.381657 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.398268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 268/541] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:13.398268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.409823 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f2e6e-e7ae-4bf7-8ebf-02c2e573dfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.410484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2e6e-e7ae-4bf7-8ebf-02c2e573dfe8 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.410768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2e6e-e7ae-4bf7-8ebf-02c2e573dfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.411056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2e6e-e7ae-4bf7-8ebf-02c2e573dfe8 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.412284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f2e6e-e7ae-4bf7-8ebf-02c2e573dfe8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.413486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f2e6e-e7ae-4bf7-8ebf-02c2e573dfe8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.441231 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 274/542] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:13 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:13.442520 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217ffd6-1e89-4bc5-ae0f-2a8dbb4adc8a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.442812 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217ffd6-1e89-4bc5-ae0f-2a8dbb4adc8a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.443092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217ffd6-1e89-4bc5-ae0f-2a8dbb4adc8a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.443720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:13.444439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 275/543] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:13.445146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217ffd6-1e89-4bc5-ae0f-2a8dbb4adc8a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.491681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:13.542516 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218dae-937d-474d-9390-19112ae3c169 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.594608 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217ffd6-1e89-4bc5-ae0f-2a8dbb4adc8a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.596559 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a9d4-c6a9-4188-a74c-c6b3e13dcd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.598711 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a9d4-c6a9-4188-a74c-c6b3e13dcd28 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.599280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a9d4-c6a9-4188-a74c-c6b3e13dcd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.599764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a9d4-c6a9-4188-a74c-c6b3e13dcd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.618301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a9d4-c6a9-4188-a74c-c6b3e13dcd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.620166 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a9d4-c6a9-4188-a74c-c6b3e13dcd28 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-4244a9d4-c6a9-4188-a74c-c6b3e13dcd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:13.641651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:13.642637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:13.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:13.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:13.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:13.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 269/544] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:13.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414c05-5b41-4d46-9a3f-a21dee588126 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414c05-5b41-4d46-9a3f-a21dee588126 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.648376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4414c05-5b41-4d46-9a3f-a21dee588126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.650271 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.651259 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.651259 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.651464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.659934 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.661449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.670026 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-a4414c05-5b41-4d46-9a3f-a21dee588126 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:13.671925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a4414c05-5b41-4d46-9a3f-a21dee588126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:13.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:13.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 276/545] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:13.678504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.753985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 270/546] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:13.754836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414c05-5b41-4d46-9a3f-a21dee588126 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.782503 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:13.785051 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:13.805029 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9799c-d926-4d0d-be72-21e0e59c75a3 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.844064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063562f6-2a70-4f9a-b041-5f678fa77f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.845604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063562f6-2a70-4f9a-b041-5f678fa77f24 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.846070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063562f6-2a70-4f9a-b041-5f678fa77f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.846527 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063562f6-2a70-4f9a-b041-5f678fa77f24 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.847469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063562f6-2a70-4f9a-b041-5f678fa77f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:13.848056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063562f6-2a70-4f9a-b041-5f678fa77f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.849825 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063562f6-2a70-4f9a-b041-5f678fa77f24 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.863416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4414c05-5b41-4d46-9a3f-a21dee588126 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:13.865598 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 277/547] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:13.867172 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027f1d7-6d58-476d-902b-9c97463a2010 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.867686 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027f1d7-6d58-476d-902b-9c97463a2010 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.868174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027f1d7-6d58-476d-902b-9c97463a2010 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.869866 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 278/548] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:13.870827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027f1d7-6d58-476d-902b-9c97463a2010 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:13.903272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd8ca5-1559-46cd-a7b4-7b482ff7a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:13.904612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd8ca5-1559-46cd-a7b4-7b482ff7a5ca None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.904950 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd8ca5-1559-46cd-a7b4-7b482ff7a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.905285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd8ca5-1559-46cd-a7b4-7b482ff7a5ca None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.906004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd8ca5-1559-46cd-a7b4-7b482ff7a5ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:13.906310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd8ca5-1559-46cd-a7b4-7b482ff7a5ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:13.907995 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd8ca5-1559-46cd-a7b4-7b482ff7a5ca None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:13.931696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 271/549] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 00:24:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:13.931696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d700c-a806-47da-903b-48f1baeaf158 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:13.936776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d700c-a806-47da-903b-48f1baeaf158 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:13.937124 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d700c-a806-47da-903b-48f1baeaf158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:13.956412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-211d700c-a806-47da-903b-48f1baeaf158 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:13.957723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-211d700c-a806-47da-903b-48f1baeaf158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:13.994939 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027f1d7-6d58-476d-902b-9c97463a2010 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.032920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.033559 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.033841 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.034113 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.035777 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 272/550] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 00:24:14.037174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d700c-a806-47da-903b-48f1baeaf158 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.042799 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.044879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.053273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:14.058769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:14.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:14.061781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 279/551] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 00:24:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:14.069094 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.071376 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.154087 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d700c-a806-47da-903b-48f1baeaf158 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.195522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.196274 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.196615 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.197114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.209051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b200c8-c6f2-4f0d-aaa8-af6ec9428946 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.209214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.210730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:14.227389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:14.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:14.229287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:14.229287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:14.229287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:14.229287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 273/552] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:14.230202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.256790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.258016 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.258495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.259372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.274411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:14.281551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:14.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:14.283309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:14.285893 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 280/553] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:14.291087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.313793 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.360597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e20378-9f3c-45ab-8aff-c7c0da1b96f4 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.362049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.397769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.398400 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.398781 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.399052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.399913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:14.400217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.401708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.406962 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f5da-908c-4d43-a570-5d63b9304388 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.420898 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 274/554] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:14.421717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.447892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.448494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.448773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.449080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.449713 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:14.450014 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.452088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.463707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 281/555] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:14.464477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.534860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63098f-c1b7-42eb-bf6f-473a0ffdf9d6 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.557485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.566360 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8122fa-50ce-4d86-b235-bfbdfce4494f None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.569423 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.570019 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.570311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.570621 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.571216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:14.571515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.572945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.582705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 275/556] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:14.587977 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.592254 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.604738 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.605367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.605646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.605917 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.606590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.608264 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.624954 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 282/557] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:14 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:14.624954 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.701770 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f18f3-cbb7-439b-aed0-a669f149d0c8 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.754556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.755175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.755451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.755722 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.758173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e69f-d87b-4537-85d3-ae5bc518eeda None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.799491 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:14.800585 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:14.800895 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:14.801173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:14.809526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.811621 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.819165 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:14.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:14.827556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:14.828494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 283/558] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:14.833605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:14.845453 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:14.847349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:14.914945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:14.970757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ece3e-d51e-4da5-9458-821bba9119c4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:14.985522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 276/559] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:24:14.987166 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.014995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.016005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.016288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.016563 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.030275 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.031723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:15.050501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:15.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:15.052352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:15.052352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:15.052352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:15.052352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 284/560] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:15.053140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.079497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:15.102430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb3501-8b21-40f6-af82-f2fdb6e057e2 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.140940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.141853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.142313 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.142761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.143707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:15.144195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.145946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.159574 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 277/561] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:15.160647 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.170070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:15.184308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0bb3d-c65f-4102-90af-7b3d43f499d0 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.235568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.236371 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.236652 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.236955 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.252904 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.254365 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:15.274592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:15.275592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:15.276446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:15.276446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:15.276446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:15.280539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 285/562] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:15.280539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.293969 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935fc91-85f2-478b-bcd7-e4101bbeb228 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.339613 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.340471 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.341150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.341612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.342416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:15.342868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.344603 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.356078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:15.361286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 278/563] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:15.362320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.400266 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad244-eafa-4bce-a287-2c68c3f8ff34 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.436393 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.437270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.437631 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.438054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/1aa883a98a0343d2be532c739910fb13/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.440321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=1aa883a98a0343d2be532c739910fb13, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.441874 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.461000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 286/564] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:24:15 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/1aa883a98a0343d2be532c739910fb13/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:24:15.464995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.470856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:15.483452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b3359-3b7f-4973-b3f5-a9d06920fb2e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.524331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.525619 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.526127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.527063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.527939 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:15.529172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.531102 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.545347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 279/565] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:15.559410 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.686592 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:15.723016 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bffd4-e72c-4012-9bb4-4f6b3286fdba None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.723353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dbd5b-927b-4d92-b637-f359e65ba478 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.759374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec936-9082-48af-8453-3cb9c65c24c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.760008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec936-9082-48af-8453-3cb9c65c24c5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.760291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec936-9082-48af-8453-3cb9c65c24c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.760583 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec936-9082-48af-8453-3cb9c65c24c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.762337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036e98a-1ce2-4a52-9700-dbd2e5b8ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:15.763604 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036e98a-1ce2-4a52-9700-dbd2e5b8ac39 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036e98a-1ce2-4a52-9700-dbd2e5b8ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.764353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036e98a-1ce2-4a52-9700-dbd2e5b8ac39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.769106 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ec936-9082-48af-8453-3cb9c65c24c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.770501 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ec936-9082-48af-8453-3cb9c65c24c5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.771666 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036e98a-1ce2-4a52-9700-dbd2e5b8ac39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:15.773937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036e98a-1ce2-4a52-9700-dbd2e5b8ac39 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-c86ec936-9082-48af-8453-3cb9c65c24c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:15.782038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:15.783013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:15.783953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 287/566] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:24:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:15.784774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928042-b24b-4ab1-9626-53b99e7457ab None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.785100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928042-b24b-4ab1-9626-53b99e7457ab None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.785374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928042-b24b-4ab1-9626-53b99e7457ab None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-a036e98a-1ce2-4a52-9700-dbd2e5b8ac39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:15.787079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:15.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:15.789265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:15.789772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 288/567] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:15.789871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 280/568] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:15.793745 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84928042-b24b-4ab1-9626-53b99e7457ab None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.795233 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83a85-9cf8-44bf-b4f6-f0fa4b319063 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:15.795512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83a85-9cf8-44bf-b4f6-f0fa4b319063 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:15.795779 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83a85-9cf8-44bf-b4f6-f0fa4b319063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:15.815344 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-10f83a85-9cf8-44bf-b4f6-f0fa4b319063 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:15.816530 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-10f83a85-9cf8-44bf-b4f6-f0fa4b319063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:15.866008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:15.896975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 281/569] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:15.896975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f83a85-9cf8-44bf-b4f6-f0fa4b319063 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:15.928924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84928042-b24b-4ab1-9626-53b99e7457ab None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:15.962992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:16.002995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.003610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.003888 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.004161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.005007 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:16.005317 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.006911 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.015257 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f83a85-9cf8-44bf-b4f6-f0fa4b319063 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:16.042767 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 289/570] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 00:24:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:16.048052 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:16.058280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.059192 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.059621 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.060567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.061432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:16.061882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.077294 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 282/571] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:16.088311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:16.262342 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce763524-c85d-454c-87ff-cf682faa8c3a None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:16.266519 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593424ae-da68-4f35-bcac-64f5fec615b4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:16.285249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:16.300526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:16.314517 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.315131 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.315409 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.315680 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.316401 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=a7e3cacb07c94c508868cff854dae659) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:16.316707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.318143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.321383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.322016 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.322286 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.322565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.326430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 283/572] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/role_assignments?user.id=a7e3cacb07c94c508868cff854dae659&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:16.327486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:16.333577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.335046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:16.351892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:16.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:16.354399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:16.354399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:16.354399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:16.354399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 290/573] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:16.362806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:16.520796 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51775c-cdb3-41e6-8a0e-9a2c3c47ad94 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:16.560402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96faf-7f0c-40c2-a091-2bd02acc6429 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:16.583860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.584905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.585543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.586032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.586890 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.588632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:16.602066 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:16.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:16.603874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:16.606354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 284/574] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:16.611766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:16.626570 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.627189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.627469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.627740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.628391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:16.628694 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.630083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.643670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 291/575] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:16.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:16.673198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:16.693799 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:16.789261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f003a10-93d5-4d30-857b-2896b1d0953b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:16.816335 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7969f-faac-4f87-8ee8-ab878a85ac18 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:16.855675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.856574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.857565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.858161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.866458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.868477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:16.882053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:16.882993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:16.883923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:16.884361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:16.884361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:16.884361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:16.884361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:16.884605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:16.884605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:16.886641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:16.887085 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 292/576] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:16.893357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:16.907164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 285/577] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:16.912496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:17.010419 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:17.022288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa9ba-dd76-43e4-a811-6801a566f2c7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:17.057987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726a3de-9af4-4fff-b128-dc44c30279a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:17.058901 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726a3de-9af4-4fff-b128-dc44c30279a3 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.059388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726a3de-9af4-4fff-b128-dc44c30279a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.060351 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726a3de-9af4-4fff-b128-dc44c30279a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.061240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726a3de-9af4-4fff-b128-dc44c30279a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:17.061722 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726a3de-9af4-4fff-b128-dc44c30279a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:17.063314 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726a3de-9af4-4fff-b128-dc44c30279a3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:17.076353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 293/578] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:17.077862 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df1f4-88dd-47eb-898a-d89198470b1a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.078344 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df1f4-88dd-47eb-898a-d89198470b1a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.078791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df1f4-88dd-47eb-898a-d89198470b1a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.080436 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 294/579] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:17.082056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df1f4-88dd-47eb-898a-d89198470b1a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:17.085648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eee4cc-4b2d-469b-9f0d-83eb9bbbff9e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:17.089359 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:17.137333 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3bf0c-815e-4677-9fdf-977945d47f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:17.138554 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3bf0c-815e-4677-9fdf-977945d47f82 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.139029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3bf0c-815e-4677-9fdf-977945d47f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.139484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3bf0c-815e-4677-9fdf-977945d47f82 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.140288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3bf0c-815e-4677-9fdf-977945d47f82 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:17.140773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3bf0c-815e-4677-9fdf-977945d47f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:17.142876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3bf0c-815e-4677-9fdf-977945d47f82 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:17.149458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 286/580] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 00:24:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:17.150847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f881-31ac-45b2-a15b-0c35063bc74c None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.151305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f881-31ac-45b2-a15b-0c35063bc74c None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.151743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f881-31ac-45b2-a15b-0c35063bc74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.173461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-70a1f881-31ac-45b2-a15b-0c35063bc74c None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:17.174993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-70a1f881-31ac-45b2-a15b-0c35063bc74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:17.227041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df1f4-88dd-47eb-898a-d89198470b1a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:17.254607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 287/581] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:17.255774 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f881-31ac-45b2-a15b-0c35063bc74c None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:17.269809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:17.270470 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.270749 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.271021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/688e9c5a658a4e32a4793d515ed11660/roles/4a5095badf5d4f6d9ef9d87f26f043eb` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.291174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=688e9c5a658a4e32a4793d515ed11660, role_id=4a5095badf5d4f6d9ef9d87f26f043eb)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:17.292916 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:17.323065 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 295/582] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:24:17 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/688e9c5a658a4e32a4793d515ed11660/roles/4a5095badf5d4f6d9ef9d87f26f043eb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:24:17.380250 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:17.387467 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f881-31ac-45b2-a15b-0c35063bc74c None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:17.432728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:17.433792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.434291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.435281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.436383 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] RBAC: Adding query filter params (interface=public, service_id=2c0df779bfe147ffaf347038f0038df9, region_id=RegionOne) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:17.436887 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:17.438501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:17.447053 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 288/583] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:24:17 2022] GET /identity/v3/endpoints?service_id=2c0df779bfe147ffaf347038f0038df9&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:17.453638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:17.456863 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:17.599519 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081689dc-3088-4a2e-9285-0583bb57453c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:17.646482 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:17.647029 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.647310 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.647581 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.648201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:17.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:17.660539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 296/584] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:17 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:17.691222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:17.806753 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc1da-224c-4dc3-9fd3-8d9a8f6e4509 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:17.856241 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:17.857486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:17.857769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:17.858043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:17.858642 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:17.860015 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:17.872805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:17.873931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:17.874805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 289/585] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:17 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:17.879915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:17.970872 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:18.007135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2c96d-f9e7-4215-9769-27aeb2405504 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:18.045763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2c3e6-e8e0-4b44-a61a-376c57199e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:18.047192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c3e6-e8e0-4b44-a61a-376c57199e5c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.047678 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c3e6-e8e0-4b44-a61a-376c57199e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.048151 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2c3e6-e8e0-4b44-a61a-376c57199e5c None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:18.049059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c3e6-e8e0-4b44-a61a-376c57199e5c None admin] RBAC: Adding query filter params (name=network) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:18.049613 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c3e6-e8e0-4b44-a61a-376c57199e5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:18.051234 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2c3e6-e8e0-4b44-a61a-376c57199e5c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:18.056652 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 297/586] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:18.062479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:18.066307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388dee2-8bdd-4a01-a1ea-4fbcf9b6368d None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.066595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388dee2-8bdd-4a01-a1ea-4fbcf9b6368d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.066869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388dee2-8bdd-4a01-a1ea-4fbcf9b6368d None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:18.068196 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 298/587] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:18.073373 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18886e-1fc5-498c-b187-55acaa607085 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.073661 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18886e-1fc5-498c-b187-55acaa607085 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.073934 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18886e-1fc5-498c-b187-55acaa607085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:18.093412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-7e18886e-1fc5-498c-b187-55acaa607085 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:18.094613 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-7e18886e-1fc5-498c-b187-55acaa607085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:18.119251 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:18.196315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 299/588] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:18.246954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b76df-b32f-408c-8597-1efaabcba1d8 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:18.287874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:18.288489 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.288772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.289075 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:18.289708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] RBAC: Adding query filter params (type=network) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:18.290016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:18.291371 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:18.296725 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 290/589] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:18.302090 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18886e-1fc5-498c-b187-55acaa607085 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:18.392204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:18.440730 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18886e-1fc5-498c-b187-55acaa607085 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:18.490386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:18.491361 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.491845 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.492331 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:18.493255 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] RBAC: Adding query filter params (interface=public, service_id=f5040223669c4dada6b33b2e7c5e8afc, region_id=RegionOne) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:18.493760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:18.495315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:18.507057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 300/590] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:24:18 2022] GET /identity/v3/endpoints?service_id=f5040223669c4dada6b33b2e7c5e8afc&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:18.513538 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:18.621152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:18.661435 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:18.688107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feda958-50e3-4961-9072-4bd048d19e7d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:18.742583 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801b829-b416-412a-9195-073a5733527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:18.743119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801b829-b416-412a-9195-073a5733527d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.743402 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801b829-b416-412a-9195-073a5733527d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.744196 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801b829-b416-412a-9195-073a5733527d None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:18.744821 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801b829-b416-412a-9195-073a5733527d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:18.746693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801b829-b416-412a-9195-073a5733527d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:18.754218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 291/591] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:18 2022] GET /identity/v3/services => generated 772 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:18.785891 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281e85-2c13-4eea-9768-d4cdbc590bfe None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:18.829443 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:18.844245 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b8936-ae9d-46bc-ae96-eaf46c253ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:18.844941 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b8936-ae9d-46bc-ae96-eaf46c253ebd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.845227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b8936-ae9d-46bc-ae96-eaf46c253ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.845506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b8936-ae9d-46bc-ae96-eaf46c253ebd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:18.865688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b8936-ae9d-46bc-ae96-eaf46c253ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-bf6b8936-ae9d-46bc-ae96-eaf46c253ebd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:18.871306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:18.873042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:18.873859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 301/592] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:18.879701 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801b829-b416-412a-9195-073a5733527d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:18.999264 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bc9e9-7746-4e4e-aa39-dddcb87ce4b1 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:18.999566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bc9e9-7746-4e4e-aa39-dddcb87ce4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:18.999721 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bc9e9-7746-4e4e-aa39-dddcb87ce4b1 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.001140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 302/593] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:19.010291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1b92-72d7-4847-bcd5-9739d8602cfd None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:19.010604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1b92-72d7-4847-bcd5-9739d8602cfd None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:19.010840 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1b92-72d7-4847-bcd5-9739d8602cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.020880 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801b829-b416-412a-9195-073a5733527d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:19.038763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-777c1b92-72d7-4847-bcd5-9739d8602cfd None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:19.040006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-777c1b92-72d7-4847-bcd5-9739d8602cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:19.059499 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:19.060261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:19.060542 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:19.060817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.062169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:19.062169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:19.063193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:19.073042 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 292/594] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:19.079368 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:19.096433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:19.128824 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 303/595] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:19.196169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8442d25-60d4-466b-94fc-920d170bbe87 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:19.233032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:19.233914 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:19.234357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:19.234780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.245183 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:19.246762 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:19.261752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:19.263388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:19.264487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:19.264487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:19.264487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:19.266167 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 293/596] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:19.273937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1b92-72d7-4847-bcd5-9739d8602cfd None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:19.425465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1b92-72d7-4847-bcd5-9739d8602cfd None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:19.446322 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:19.475419 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:19.476038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:19.476318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:19.476591 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.477262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:19.477564 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:19.478943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:19.487280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:19.495175 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 304/597] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:19.501703 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:19.564241 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:19.604361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799fb3-4b3e-48af-b989-1aca020218e6 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:19.645787 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:19.646796 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:19.647295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:19.647803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.648627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:19.650734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:19.660752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:19.662050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:19.662909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:19.665890 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 294/598] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 00:24:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:19.672886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:19.746991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d6c1-3743-401e-83b5-3e4d58aee229 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:19.788255 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc4eac-08d4-493f-ab86-eeefcd6b5055 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:19.819593 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:19.821557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:19.822246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:19.822533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:19.823566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.832671 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:19.834173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:19.837547 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:19.838164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:19.838448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:19.838724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:19.839360 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:19.839665 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:19.841692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:19.852109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:19.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:19.854021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 305/599] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:19.856336 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 295/600] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:19.860884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:19.863437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:19.931013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:20.078621 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed76b-9dd2-448a-9ebc-1fc28e4423d9 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:20.083584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92106a-df9c-4e82-b761-1a4bec12d3bc None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:20.134279 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:20.134926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.135177 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.135455 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.136187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:20.136498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:20.138006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:20.145422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd0950-8c8c-40e5-bcf8-e368d8e10bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:20.146283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd0950-8c8c-40e5-bcf8-e368d8e10bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.146750 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd0950-8c8c-40e5-bcf8-e368d8e10bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.147300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd0950-8c8c-40e5-bcf8-e368d8e10bb8 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.148228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd0950-8c8c-40e5-bcf8-e368d8e10bb8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:20.148730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd0950-8c8c-40e5-bcf8-e368d8e10bb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:20.150286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd0950-8c8c-40e5-bcf8-e368d8e10bb8 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:20.156186 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 296/601] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:20.157674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65245332-cdcb-4ffa-82e5-3ed82ecfd353 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.157807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 306/602] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 00:24:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:20.158303 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65245332-cdcb-4ffa-82e5-3ed82ecfd353 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.158681 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65245332-cdcb-4ffa-82e5-3ed82ecfd353 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.160140 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 297/603] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:20.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:20.170961 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29705a0-3b99-4f8e-a9df-2e4c3c080a79 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.171248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29705a0-3b99-4f8e-a9df-2e4c3c080a79 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.171524 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29705a0-3b99-4f8e-a9df-2e4c3c080a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.192368 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-c29705a0-3b99-4f8e-a9df-2e4c3c080a79 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:20.193653 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-c29705a0-3b99-4f8e-a9df-2e4c3c080a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:20.260901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:20.283029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 298/604] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:20.349186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:20.360606 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d29ad-1cf8-46ac-bb34-3f4072dd66b1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:20.397036 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:20.397658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.397941 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.398217 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.484045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:20.485587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:20.589634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef756-4630-4012-8e1b-f18373572197 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.589859 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef756-4630-4012-8e1b-f18373572197 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.590082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef756-4630-4012-8e1b-f18373572197 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.591610 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 299/605] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:20.602136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361becd1-3323-4755-8db9-16a5b87e0b56 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.602382 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361becd1-3323-4755-8db9-16a5b87e0b56 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.602628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361becd1-3323-4755-8db9-16a5b87e0b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.607968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:20.619975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 307/606] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:24:20.620813 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:20.629948 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-361becd1-3323-4755-8db9-16a5b87e0b56 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:20.631644 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-361becd1-3323-4755-8db9-16a5b87e0b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:20.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 300/607] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:20.720674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361becd1-3323-4755-8db9-16a5b87e0b56 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:20.724685 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a3372-e7b9-40c4-8ecb-4204d35e5e84 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:20.769006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:20.769006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.769006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.769006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.789485 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:20.796577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:20.797727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:24:20.798582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:20.802092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 308/608] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:20.811175 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:20.871223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361becd1-3323-4755-8db9-16a5b87e0b56 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:20.889819 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:20.908013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:20.908650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:20.908957 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:20.909230 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:20.921480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:20.922928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:20.939938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:20.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:20.942388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:20.942388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:20.942388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:20.942388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 301/609] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:20.947175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:20.964434 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:21.068139 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca708d4-ac41-4878-ba4a-c981db5120f8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.073848 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adf941-4836-4820-8338-4fba9627436b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.109387 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.110019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.110281 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.110540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.111207 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:21.111500 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.112889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.114290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.115140 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.115626 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.116163 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.117060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:21.117607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.119174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.123151 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 309/610] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:21.123995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.135701 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 302/611] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:21.137359 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.177659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:21.264783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942ce1f-f235-43f0-b117-71f649322d57 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.275463 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72e3bd-2a00-4fd5-8eb1-56f00a687c40 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.281803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:21.304368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.305199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.305582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.305954 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.306642 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.308115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:21.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:21.319540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 00:24:21.320574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:21.322752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 310/612] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:21.324498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.335422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299e33-e36c-439f-8878-e36513627752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.336341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299e33-e36c-439f-8878-e36513627752 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.336784 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299e33-e36c-439f-8878-e36513627752 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.337715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299e33-e36c-439f-8878-e36513627752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.352172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28299e33-e36c-439f-8878-e36513627752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.354304 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28299e33-e36c-439f-8878-e36513627752 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-28299e33-e36c-439f-8878-e36513627752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:21.373045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:21.374267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:21.375340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:21.375340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:21.375340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:21.376708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 303/613] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:21.377681 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299e33-e36c-439f-8878-e36513627752 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.458454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d67c-0e15-43ae-a00f-bc82e6f192b4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.474211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:21.494740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299e33-e36c-439f-8878-e36513627752 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.507062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.507896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.508661 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.509117 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.518429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.520825 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.534234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.534996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.535385 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.535788 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.536527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:21.537008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:21.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:21.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:21.539659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.541391 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.541564 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 311/614] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:21.542596 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.551324 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 304/615] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:21.551324 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.592009 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:21.653916 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbd9d-0e07-41d4-8d4e-308870e72019 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.673348 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa36a-0796-4c5d-a4a7-1804111e96a0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.692437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.693073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.693359 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.693635 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.694293 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:21.694589 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.695956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.712647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 312/616] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:21.712647 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.715416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a7cc1-ddf7-43ed-a0fb-f89227aeffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.716127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a7cc1-ddf7-43ed-a0fb-f89227aeffc2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.716517 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a7cc1-ddf7-43ed-a0fb-f89227aeffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.716794 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a7cc1-ddf7-43ed-a0fb-f89227aeffc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.717512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a7cc1-ddf7-43ed-a0fb-f89227aeffc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:21.717817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a7cc1-ddf7-43ed-a0fb-f89227aeffc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.719221 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a7cc1-ddf7-43ed-a0fb-f89227aeffc2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.737428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 305/617] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:21.737428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb41713-9080-431c-b114-38abe416f947 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.737428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb41713-9080-431c-b114-38abe416f947 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.737428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb41713-9080-431c-b114-38abe416f947 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.740107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 306/618] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:21.740876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb41713-9080-431c-b114-38abe416f947 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.751278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:21.816180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:21.820439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059003d9-bc82-4643-a712-33791f52f123 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.856097 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb41713-9080-431c-b114-38abe416f947 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:21.861291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.861906 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.862191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.862468 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.863102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:21.863410 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.865220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.871953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 313/619] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:21.872879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:21.891721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59282c-6de6-43f1-bb49-fc3c63d5ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:21.892747 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59282c-6de6-43f1-bb49-fc3c63d5ad01 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.893443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59282c-6de6-43f1-bb49-fc3c63d5ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.893725 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59282c-6de6-43f1-bb49-fc3c63d5ad01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.900940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59282c-6de6-43f1-bb49-fc3c63d5ad01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:21.902358 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59282c-6de6-43f1-bb49-fc3c63d5ad01 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-8d59282c-6de6-43f1-bb49-fc3c63d5ad01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:21.914581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:21.915477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:21.916405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 307/620] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:21.917043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d491696-083a-4a85-bf15-0829e160076e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:21.917043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d491696-083a-4a85-bf15-0829e160076e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:21.917194 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d491696-083a-4a85-bf15-0829e160076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:21.940573 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-6d491696-083a-4a85-bf15-0829e160076e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:21.941827 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6d491696-083a-4a85-bf15-0829e160076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:21.993727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd438c1-3564-4b3f-8901-dd550a696fee None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:22.000771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:22.016873 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 308/621] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:22.016873 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d491696-083a-4a85-bf15-0829e160076e None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.043034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:22.044368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.044721 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.045094 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.046162 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=1aa883a98a0343d2be532c739910fb13) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:22.046547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:22.048996 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:22.056889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 314/622] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:21 2022] GET /identity/v3/role_assignments?user.id=1aa883a98a0343d2be532c739910fb13&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:22.058896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.121227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:22.176121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d491696-083a-4a85-bf15-0829e160076e None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:22.244184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:22.244803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.245104 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.245371 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.246047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:22.248073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:22.259771 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6927d-a101-45c3-b523-f86df3f9cf00 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:22.283325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 309/623] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:22.314294 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:22.314987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.315244 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.315514 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.316285 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:22.316590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:22.318076 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:22.319631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.352899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 315/624] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 00:24:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:22.358190 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.391757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:22.447943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5437e-03e1-4d3a-a117-9d0536972d5d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:22.458515 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:22.482058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325144d-c784-4afa-ab2b-8e3793182133 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:22.493047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:22.493695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.494317 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.494439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] PATH_INFO: `/v3/services/network` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.494934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:22.496412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:22.506634 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:22.507652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:22.514572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 310/625] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:22 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:22.518755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.532661 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b224a0-26af-4bd8-8945-407e33b54b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:22.533806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b224a0-26af-4bd8-8945-407e33b54b81 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.534085 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b224a0-26af-4bd8-8945-407e33b54b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.534354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b224a0-26af-4bd8-8945-407e33b54b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.634825 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b224a0-26af-4bd8-8945-407e33b54b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:22.636279 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b224a0-26af-4bd8-8945-407e33b54b81 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:22.656789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e1a1b-a937-4222-9a73-a5eeee4862ae None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:22.679811 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:22.704408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f753b79-f70b-4a1d-9df9-090e621e0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:22.704974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f753b79-f70b-4a1d-9df9-090e621e0839 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.705264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f753b79-f70b-4a1d-9df9-090e621e0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.705552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f753b79-f70b-4a1d-9df9-090e621e0839 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.706831 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f753b79-f70b-4a1d-9df9-090e621e0839 None admin] RBAC: Adding query filter params (name=network) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:22.706831 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f753b79-f70b-4a1d-9df9-090e621e0839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:22.707824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f753b79-f70b-4a1d-9df9-090e621e0839 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:22.713041 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 311/626] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:22.714071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b402e-0ef6-46cc-ba1d-cc1f1f4299d2 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.714357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b402e-0ef6-46cc-ba1d-cc1f1f4299d2 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.714633 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b402e-0ef6-46cc-ba1d-cc1f1f4299d2 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.716555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 312/627] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:22.722091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b402e-0ef6-46cc-ba1d-cc1f1f4299d2 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.755156 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:22.785665 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 316/628] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:24:22.787882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c86c9-451a-431a-9395-cf9d3a8a35ee None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.788380 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c86c9-451a-431a-9395-cf9d3a8a35ee None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.788920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c86c9-451a-431a-9395-cf9d3a8a35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.808557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-d71c86c9-451a-431a-9395-cf9d3a8a35ee None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:22.810465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d71c86c9-451a-431a-9395-cf9d3a8a35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:22.842698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b402e-0ef6-46cc-ba1d-cc1f1f4299d2 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:22.884492 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:22.885115 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:22.885397 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:22.885671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:22.886138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 317/629] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:22.886331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] RBAC: Adding query filter params (type=network) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:22.886605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:22.886994 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c86c9-451a-431a-9395-cf9d3a8a35ee None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.888824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:22.894506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 313/630] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:22.901533 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:22.991420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:23.046476 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c86c9-451a-431a-9395-cf9d3a8a35ee None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:23.064654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:23.092712 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63d3bb-a181-4d72-97ed-e45ed96c5161 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:23.106213 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:23.107577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:23.107953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:23.108320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:23.119210 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:23.120766 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:23.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:23.138400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:23.139440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:23.139440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:23.139440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:23.139440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 318/631] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:23.145509 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:23.164094 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:23.164711 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:23.165011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:23.165283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:23.165948 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:23.167299 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:23.204855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 314/632] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:23.240948 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:23.331130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2015092-8f8a-42f9-bc6a-1972fd3721e8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:23.410737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:23.411345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:23.411619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:23.412140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:23.414781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:23.414781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:23.414781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:23.426594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:23.430791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a5c3-c6dd-4e5f-b07e-7e4ded38689c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:23.430958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 319/633] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:23.437087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:23.463713 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:23.471344 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:23.472107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:23.472492 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:23.472938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:23.473752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:23.475217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:23.499563 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 315/634] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:23 2022] POST /identity/v3/services => generated 269 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:24:23.570013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3339-8833-4399-bdb7-7f66d6a44b77 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:23.623316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:23.624255 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:23.624761 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:23.625193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:23.633423 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:23.635236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:23.648602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:23.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:23.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:23.653074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 320/635] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:23.659236 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:23.783539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455b922-6286-4f2f-8d29-01136fd4dd65 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:23.818736 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcdd15-8e77-4b9c-8a8c-049d8d2b9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:23.819352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcdd15-8e77-4b9c-8a8c-049d8d2b9568 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:23.819636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcdd15-8e77-4b9c-8a8c-049d8d2b9568 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:23.819917 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcdd15-8e77-4b9c-8a8c-049d8d2b9568 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:23.820609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcdd15-8e77-4b9c-8a8c-049d8d2b9568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:23.820948 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcdd15-8e77-4b9c-8a8c-049d8d2b9568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:23.822387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcdd15-8e77-4b9c-8a8c-049d8d2b9568 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:23.835901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 316/636] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:23.842530 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:23.932339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:23.956804 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c201-7430-4c66-9400-709b392cf754 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:23.992805 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21001176-2464-454f-af3e-16575a30e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:23.993435 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21001176-2464-454f-af3e-16575a30e413 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:23.993715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21001176-2464-454f-af3e-16575a30e413 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:23.993990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21001176-2464-454f-af3e-16575a30e413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:23.994711 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21001176-2464-454f-af3e-16575a30e413 None admin] RBAC: Adding query filter params (role.id=4a5095badf5d4f6d9ef9d87f26f043eb, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=688e9c5a658a4e32a4793d515ed11660) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:23.995022 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21001176-2464-454f-af3e-16575a30e413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:23.996441 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21001176-2464-454f-af3e-16575a30e413 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:24.003272 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 321/637] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:23 2022] GET /identity/v3/role_assignments?user.id=688e9c5a658a4e32a4793d515ed11660&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=4a5095badf5d4f6d9ef9d87f26f043eb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:24.686608 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89125c-fe3a-4097-adec-00c93b65b9aa None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:24.687135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89125c-fe3a-4097-adec-00c93b65b9aa None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:24.687435 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89125c-fe3a-4097-adec-00c93b65b9aa None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:24.689148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 317/638] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:24.694515 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20316f38-53cb-42cb-88ae-37ce3e555a1b None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:24.694919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20316f38-53cb-42cb-88ae-37ce3e555a1b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:24.695254 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20316f38-53cb-42cb-88ae-37ce3e555a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:24.713597 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-20316f38-53cb-42cb-88ae-37ce3e555a1b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:24.714805 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-20316f38-53cb-42cb-88ae-37ce3e555a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:24.787882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 322/639] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:24.911003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c8ed-d16a-4462-9e6c-2061d38e1c25 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:24.911361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c8ed-d16a-4462-9e6c-2061d38e1c25 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:24.911563 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c8ed-d16a-4462-9e6c-2061d38e1c25 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:24.913561 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 318/640] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:24.919965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98415d0-6849-493e-96f8-3081e1c9f455 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:24.920276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98415d0-6849-493e-96f8-3081e1c9f455 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:24.920527 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98415d0-6849-493e-96f8-3081e1c9f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:24.941963 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-c98415d0-6849-493e-96f8-3081e1c9f455 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:24.943092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c98415d0-6849-493e-96f8-3081e1c9f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:25.006391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:25.011999 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 323/641] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:25.071864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c8ed-d16a-4462-9e6c-2061d38e1c25 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:25.094684 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:25.177047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c8ed-d16a-4462-9e6c-2061d38e1c25 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:25.211571 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:25.212119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.212396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.212669 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.213273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:25.214616 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:25.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:25.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:25.225297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 319/642] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:25.230532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98415d0-6849-493e-96f8-3081e1c9f455 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:25.310893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:25.339395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98415d0-6849-493e-96f8-3081e1c9f455 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:25.390390 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:25.391003 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.391281 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.391551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.392176 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:25.392724 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:25.394727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:25.401337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 324/643] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:25.408341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:25.417971 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:25.436695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d263-bd90-4489-965d-fa7cbf92f912 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:25.473453 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:25.474002 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.474284 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.474558 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.475201 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:25.476613 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:25.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:25.486902 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:25.487719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 320/644] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:25.489879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:25.495469 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:25.548086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216b63-1922-4cf5-ab4a-b545c9ba8dbc None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:25.593287 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:25.593905 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.594186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.594459 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.595089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:25.595394 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:25.596796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:25.605678 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 325/645] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:25.613251 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00082-4bc2-4ca4-8c90-b5d45a087a5d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:25.655085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2628943-d5f3-4907-9dc6-2338c8a1e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:25.656114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2628943-d5f3-4907-9dc6-2338c8a1e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.656645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2628943-d5f3-4907-9dc6-2338c8a1e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.657172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2628943-d5f3-4907-9dc6-2338c8a1e3f9 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.658028 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2628943-d5f3-4907-9dc6-2338c8a1e3f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:25.658542 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2628943-d5f3-4907-9dc6-2338c8a1e3f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:25.660163 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2628943-d5f3-4907-9dc6-2338c8a1e3f9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:25.666724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 321/646] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:25.675130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:25.794454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667c70b-7c46-4686-aeab-c54bca8644ac None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:25.825744 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:25.826844 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413f4ad-55a0-41e2-80e2-eef28059aafe None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.827325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413f4ad-55a0-41e2-80e2-eef28059aafe None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.827325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413f4ad-55a0-41e2-80e2-eef28059aafe None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.828868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 322/647] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:24:25.834635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecac7ae-d7d1-441f-af60-cd13528ef46b None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.834635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecac7ae-d7d1-441f-af60-cd13528ef46b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.834635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecac7ae-d7d1-441f-af60-cd13528ef46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.846249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:25.847223 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:25.847506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:25.847784 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:25.848425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:25.849723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:25.851092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:25.860866 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 326/648] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:25.866852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-9ecac7ae-d7d1-441f-af60-cd13528ef46b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:25.868152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9ecac7ae-d7d1-441f-af60-cd13528ef46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:25.877805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:25.949154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 323/649] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:25 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:26.224149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:26.256587 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6283a75-d606-41ba-9b5b-60944e0ddaed None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:26.257018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6283a75-d606-41ba-9b5b-60944e0ddaed None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:26.257373 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6283a75-d606-41ba-9b5b-60944e0ddaed None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:26.259050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 324/650] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:26.264580 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664d6b-27fb-4b2d-b72b-5f709de84b29 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:26.264727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664d6b-27fb-4b2d-b72b-5f709de84b29 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:26.265101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664d6b-27fb-4b2d-b72b-5f709de84b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:26.283915 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-51664d6b-27fb-4b2d-b72b-5f709de84b29 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:26.285286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-51664d6b-27fb-4b2d-b72b-5f709de84b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:26.335034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a65a-65ad-458e-85f4-c3470781919a None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:26.369171 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 325/651] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:26 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:26.385072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:26.386089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:26.386521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:26.386944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:26.388290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:26.389894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:26.399321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:26.400483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:26.401639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:26.404131 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 327/652] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 00:24:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:26.410114 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51664d6b-27fb-4b2d-b72b-5f709de84b29 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:26.492937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:26.522194 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51664d6b-27fb-4b2d-b72b-5f709de84b29 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:26.557448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:26.558086 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:26.558372 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:26.558652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:26.559341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:26.559679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:26.561209 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:26.567106 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 326/653] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:26.572740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:26.635193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:26.683291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8167a9-892e-4c35-8f7a-5e30e82bb702 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:26.698214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:26.729302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:26.730693 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:26.731859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:26.732422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:26.733261 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:26.733895 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:26.736091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:26.742907 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 328/654] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:26.750049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:26.831425 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fcb4a-9e55-4515-9343-dea04597fc2e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:26.866298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:26.866923 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:26.867210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:26.867486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:26.873476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:26.876855 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbad230-d7dd-4616-bfa8-287b9bb5961a None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:26.879286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:26.884506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:26.885512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:26.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:26.891133 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 327/655] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 00:24:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:26.892376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:26.901027 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:26.920149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:26.920935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:26.921415 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:26.921797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:26.922719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] RBAC: Adding query filter params (interface=public, service_id=f6f2166c05e54f62ac27143b6708fbeb, region_id=RegionOne) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:26.923161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:26.924735 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:26.941005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 329/656] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:24:26 2022] GET /identity/v3/endpoints?service_id=f6f2166c05e54f62ac27143b6708fbeb&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:26.946381 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:27.017491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafbc61-e4a9-4e23-875c-335980ec25d8 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:27.063003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:27.063981 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.064446 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.064900 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.065573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538df20-04b1-47f7-9b63-341e8624da6f None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:27.065917 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:27.066372 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:27.068055 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:27.079602 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 328/657] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 00:24:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:27.084778 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:27.105855 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:27.106933 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.107481 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.107950 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.108772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:27.110887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:27.117727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 330/658] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:26 2022] GET /identity/v3/services => generated 1029 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:24:27.148057 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:27.194151 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6b21-d67b-4a5a-b12f-4a3a98a8a43e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:27.230824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:27.232002 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.232277 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.232545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.244247 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:27.245752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:27.262275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:27.263326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:27.264202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:27.264202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:27.264202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:27.264202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 329/659] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:27.269347 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:27.325391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:27.383569 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d500-a4aa-4b47-b25a-5fefb403a0f5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:27.419209 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:27.419814 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.420088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.420357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.421020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:27.421325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:27.422685 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:27.436091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 331/660] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:27.441858 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:27.549033 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c007510-eaaa-4799-87b5-3525ac3d115c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:27.564244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:27.588483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:27.589130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.589405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.589716 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.598029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:27.599460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:27.610976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:27.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:27.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 330/661] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:24:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:27.619853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:27.728811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbabb60-52ae-475f-af00-d1fd509522fd None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:27.737806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:27.766544 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ef86-2b23-4e90-8123-e6456a9c7540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:27.767602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ef86-2b23-4e90-8123-e6456a9c7540 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.768088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ef86-2b23-4e90-8123-e6456a9c7540 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.768594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ef86-2b23-4e90-8123-e6456a9c7540 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.769554 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530ef86-2b23-4e90-8123-e6456a9c7540 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:27.770083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530ef86-2b23-4e90-8123-e6456a9c7540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:27.771717 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530ef86-2b23-4e90-8123-e6456a9c7540 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:27.792611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 332/662] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 00:24:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:27.802077 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:27.908066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d5e83-46de-4055-8183-0336f6ea5531 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.909059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d5e83-46de-4055-8183-0336f6ea5531 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.909586 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d5e83-46de-4055-8183-0336f6ea5531 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.911404 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 333/663] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:27.915067 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa47b0-8c50-46ae-afc5-d0d90d85f7f0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:27.916978 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52d605-085f-4ce4-b81b-c310445cbb59 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.917288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52d605-085f-4ce4-b81b-c310445cbb59 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.917540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52d605-085f-4ce4-b81b-c310445cbb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.948794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-3c52d605-085f-4ce4-b81b-c310445cbb59 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:27.950734 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-3c52d605-085f-4ce4-b81b-c310445cbb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:27.960005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:27.961065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:27.961535 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:27.962490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:27.979243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:27.981388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:27.997555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:27.998650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:27.999628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:27.999628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:27.999628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:27.999628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 331/664] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:28.006343 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:28.036011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:28.041590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 334/665] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:27 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:28.065505 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13906-089b-4c63-81d4-25ea3c78cc0a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.065686 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13906-089b-4c63-81d4-25ea3c78cc0a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.065893 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c13906-089b-4c63-81d4-25ea3c78cc0a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.071200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 335/666] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:24:28.072299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8af4-c815-4a42-822f-982f317e0293 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.072590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8af4-c815-4a42-822f-982f317e0293 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.072887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8af4-c815-4a42-822f-982f317e0293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.092403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-edca8af4-c815-4a42-822f-982f317e0293 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:28.093646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-edca8af4-c815-4a42-822f-982f317e0293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:28.135935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408255-00c4-49d6-ba19-db36fa55ddea None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:28.175724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:28.176335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.176611 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.176928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.177584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:28.177869 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:28.179131 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 336/667] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:28 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:28.180889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:28.194646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 332/668] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:28.200291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca8af4-c815-4a42-822f-982f317e0293 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:28.231654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:28.301947 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca8af4-c815-4a42-822f-982f317e0293 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:28.329513 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:28.339483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:28.340130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.341393 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.341740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.351112 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:28.352821 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:28.370289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:28.371180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:28.372146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 337/669] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:28.378163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:28.429923 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:28.455727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d253b-bb93-401a-86e9-77a2426f91ff None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:28.469600 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:28.487561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21dc3e-86a3-4ca0-ae0d-a4404315059d None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:28.493633 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:28.494244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.494522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.495196 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.495847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:28.498166 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:28.520993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 333/670] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:28 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:24:28.521856 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:28.547526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:28.549397 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.549977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.550424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.551601 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:28.552075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:28.554370 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:28.574566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 338/671] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:28.584809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:28.667943 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182e25-b2f1-4efd-99f7-169d97e645aa None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:28.729173 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a19a5-ac3c-43a5-b46f-7064ff77b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:28.729788 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a19a5-ac3c-43a5-b46f-7064ff77b880 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.730072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a19a5-ac3c-43a5-b46f-7064ff77b880 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.730349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a19a5-ac3c-43a5-b46f-7064ff77b880 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.731918 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a19a5-ac3c-43a5-b46f-7064ff77b880 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:28.733481 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a19a5-ac3c-43a5-b46f-7064ff77b880 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:28.735321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaf621-4daf-4fc6-bf9c-3688d74b0ac3 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:28.752471 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 334/672] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:28 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:28.784553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52925787-4fb2-424f-8a97-1fb710678e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:28.785262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925787-4fb2-424f-8a97-1fb710678e44 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:28.785540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925787-4fb2-424f-8a97-1fb710678e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:28.785811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925787-4fb2-424f-8a97-1fb710678e44 None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/688e9c5a658a4e32a4793d515ed11660/roles/10b54391b6fd4005aadbf0110e20cb50` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:28.788306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52925787-4fb2-424f-8a97-1fb710678e44 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=688e9c5a658a4e32a4793d515ed11660, role_id=10b54391b6fd4005aadbf0110e20cb50)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:28.789857 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52925787-4fb2-424f-8a97-1fb710678e44 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:28.793464 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:28.806788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 339/673] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:24:28 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/688e9c5a658a4e32a4793d515ed11660/roles/10b54391b6fd4005aadbf0110e20cb50 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:24:29.448509 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafff1b-b783-49ef-aef4-8138ff73d45d None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:29.449083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafff1b-b783-49ef-aef4-8138ff73d45d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:29.449083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafff1b-b783-49ef-aef4-8138ff73d45d None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:29.451214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 335/674] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:29.456513 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317ffe-5114-47cf-adc7-ad3ddf4cfdbb None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:29.456930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317ffe-5114-47cf-adc7-ad3ddf4cfdbb None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:29.457114 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317ffe-5114-47cf-adc7-ad3ddf4cfdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:29.476637 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-60317ffe-5114-47cf-adc7-ad3ddf4cfdbb None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:29.477865 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-60317ffe-5114-47cf-adc7-ad3ddf4cfdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:29.553367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 340/675] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:29.826678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafff1b-b783-49ef-aef4-8138ff73d45d None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:29.829696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:29.938307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafff1b-b783-49ef-aef4-8138ff73d45d None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:29.974916 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:29.975889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:29.976451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:29.976963 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:29.977855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:29.979423 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:29.989766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:29.990754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 00:24:29.991658 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:29.994386 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 336/676] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 00:24:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:30.000060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317ffe-5114-47cf-adc7-ad3ddf4cfdbb None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:30.099217 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317ffe-5114-47cf-adc7-ad3ddf4cfdbb None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:30.126147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:30.135624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:30.136232 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:30.136509 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:30.136785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:30.137575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:30.137885 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:30.139307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:30.144440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 341/677] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:30.150016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:30.218722 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:30.255728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0358c04-df8d-4c3b-b027-07d5f9557f3c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:30.290440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c73b9-cbc0-474d-a104-3419e0a8864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:30.291436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c73b9-cbc0-474d-a104-3419e0a8864b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:30.291925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c73b9-cbc0-474d-a104-3419e0a8864b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:30.292416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c73b9-cbc0-474d-a104-3419e0a8864b None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:30.293270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c73b9-cbc0-474d-a104-3419e0a8864b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:30.294292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c73b9-cbc0-474d-a104-3419e0a8864b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:30.295854 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c73b9-cbc0-474d-a104-3419e0a8864b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:30.301295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 337/678] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:30.306681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:30.408300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e66eb-3821-4550-9ed6-380d66ba937e None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:30.443108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad900a-1cdf-4625-894f-68c69db30479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:30.443712 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad900a-1cdf-4625-894f-68c69db30479 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:30.444046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad900a-1cdf-4625-894f-68c69db30479 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:30.444321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad900a-1cdf-4625-894f-68c69db30479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:30.445028 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad900a-1cdf-4625-894f-68c69db30479 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:30.446386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad900a-1cdf-4625-894f-68c69db30479 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:30.490912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 342/679] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:30.990557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d4367-6173-4b42-9299-29d6593645b0 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:30.991101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d4367-6173-4b42-9299-29d6593645b0 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:30.991101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d4367-6173-4b42-9299-29d6593645b0 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:30.997645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 338/680] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:30.999314 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf10c5-d78b-4b6b-900e-8e69bfaa8879 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:30.999627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf10c5-d78b-4b6b-900e-8e69bfaa8879 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:30.999903 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf10c5-d78b-4b6b-900e-8e69bfaa8879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.023184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-baaf10c5-d78b-4b6b-900e-8e69bfaa8879 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:31.025169 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-baaf10c5-d78b-4b6b-900e-8e69bfaa8879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:31.086012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:31.119212 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 343/681] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:31.134311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c860eb-7184-4762-9f04-48bf83fb68ba None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.134641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c860eb-7184-4762-9f04-48bf83fb68ba None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.134847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c860eb-7184-4762-9f04-48bf83fb68ba None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.136464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 339/682] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:31.142377 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ffd3-fe98-4938-8dbb-f1768a61dd5b None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.142666 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ffd3-fe98-4938-8dbb-f1768a61dd5b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.142938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ffd3-fe98-4938-8dbb-f1768a61dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.145678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1cb7c-483d-45d2-80fc-fda2bc88f3cb None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.145954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1cb7c-483d-45d2-80fc-fda2bc88f3cb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.146228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1cb7c-483d-45d2-80fc-fda2bc88f3cb None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.147748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 340/683] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:31.152745 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9d404-29ea-4db6-b5e3-105e25b2fa10 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.153603 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9d404-29ea-4db6-b5e3-105e25b2fa10 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.153879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9d404-29ea-4db6-b5e3-105e25b2fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.163168 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-7be2ffd3-fe98-4938-8dbb-f1768a61dd5b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:31.164521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-7be2ffd3-fe98-4938-8dbb-f1768a61dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:31.174332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-73f9d404-29ea-4db6-b5e3-105e25b2fa10 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:31.175955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-73f9d404-29ea-4db6-b5e3-105e25b2fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:31.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 344/684] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:31.254160 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 341/685] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:31.416200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2ffd3-fe98-4938-8dbb-f1768a61dd5b None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:31.518423 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2ffd3-fe98-4938-8dbb-f1768a61dd5b None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:31.519814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9d404-29ea-4db6-b5e3-105e25b2fa10 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:31.519925 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:31.566240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:31.566934 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.567544 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.567831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.568422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:31.569823 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:31.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:31.580063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:31.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:31.584982 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 345/686] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:31.585806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:31.587296 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:31.630899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9d404-29ea-4db6-b5e3-105e25b2fa10 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:31.666508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:31.667236 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.667517 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.667789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.678581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:31.683226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:31.684261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 342/687] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 00:24:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:31.685200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:31.697438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1dadf-f2d9-4195-ba73-cccfa5609762 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:31.733374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:31.734045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.734300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.734571 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.735151 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:31.736496 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:31.744880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:31.746040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:31.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 346/688] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:31.748384 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:31.779241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:31.795393 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d154-90b0-458c-b324-a150a8bc52de None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:31.815620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:31.830367 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:31.830964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.831243 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.831511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.832136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:31.832436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:31.833850 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:31.838615 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 343/689] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:31.839478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:31.861695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af927255-9fbb-4a4a-a215-c41dab222e12 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:31.897787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:31.898380 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:31.898657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:31.898926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:31.899587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:31.899889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:31.901283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:31.915445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 347/690] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 00:24:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:31.915445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:31.967379 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73046-f107-41b7-8937-7a6c131feb07 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.003724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.004649 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.005001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.005175 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.005984 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:32.006310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.007827 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.013458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 344/691] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:32.015702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35593e1-c927-4e6f-8235-8d9faf4263e9 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.018643 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.053237 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.053938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.054280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.055171 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:32.055531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.056888 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.062540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 348/692] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:32.063300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.076003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.131452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157a642-e287-4f25-9fa7-77c309f23d15 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.166552 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f93639-910d-45dd-83a3-24dc5ad82160 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.168342 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.169034 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.169469 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.169855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.180565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.182417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:32.197085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:32.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:32.198852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:32.198852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:32.198852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:32.198852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 345/693] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:32.199075 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.209154 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.209432 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.209703 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.210330 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:32.210632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.211984 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.222718 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 349/694] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:32.222718 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.241540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.313889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.317522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65552b-19e9-45a3-9c77-391584ec6b77 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.321718 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d6d1d-653f-4dc7-8eba-847ce0f69bc6 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.354248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.354855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.355138 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.355417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.356150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] RBAC: Adding query filter params (interface=public, service_id=39d8e75930ca43539047978e05a2adec, region_id=RegionOne) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:32.356466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.357379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.357871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.357980 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.358249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.358518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.359215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:32.359483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.360807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.363875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 346/695] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/endpoints?service_id=39d8e75930ca43539047978e05a2adec&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:32.364899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.374626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 350/696] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:32.375449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.468171 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.479079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361f8a-9c06-4f6f-bacd-a8af6c7cbc55 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.489565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce1077-8fa2-46f1-bf20-b52e1eae78d8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.516239 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.516861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.517142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.517415 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.518102 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] RBAC: Adding query filter params (interface=public, service_id=6fe57657c8824fa0a47dbeb0bd37762a, region_id=RegionOne) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:32.518404 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.519905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.525475 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.525934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 347/697] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/endpoints?service_id=6fe57657c8824fa0a47dbeb0bd37762a&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:32.526264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.526946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.527230 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.527506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.528718 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.530186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.536549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 351/698] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:24:32.537625 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.565613 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.654194 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7861f-a1ca-475d-9361-8a97b3acec1e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.688150 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93831c-ca0c-4d65-b7a0-ca553a43c3ef None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.693080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.693858 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.694252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.694537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.703387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.704881 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:32.717399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:32.718408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:32.719301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 348/699] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:32.730350 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.737668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461eccd-2514-45f5-9d36-f058341963d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.738560 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461eccd-2514-45f5-9d36-f058341963d9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.738990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461eccd-2514-45f5-9d36-f058341963d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.739403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461eccd-2514-45f5-9d36-f058341963d9 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.740202 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461eccd-2514-45f5-9d36-f058341963d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.743211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461eccd-2514-45f5-9d36-f058341963d9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.752149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 352/700] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/services => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:24:32.842624 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.847191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c495-9968-4000-8620-0183e58e0a96 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.849315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c495-9968-4000-8620-0183e58e0a96 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.849315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c495-9968-4000-8620-0183e58e0a96 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.850900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 353/701] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:32.855576 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9aa1e-54da-4117-aa1b-d6db628aec17 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.855868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9aa1e-54da-4117-aa1b-d6db628aec17 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.856690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9aa1e-54da-4117-aa1b-d6db628aec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.856994 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8fd3-6ae7-4994-855a-4117903f608d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:32.878645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-3ad9aa1e-54da-4117-aa1b-d6db628aec17 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:32.879896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-3ad9aa1e-54da-4117-aa1b-d6db628aec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:32.899562 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:32.900182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:32.900463 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:32.900743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:32.901564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:32.902071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:32.904657 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:32.921831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:32.927289 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 349/702] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:32.938016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:32.969856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 354/703] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:33.050436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7218ad-46ba-4089-b092-39cb5c825e47 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:33.087331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:33.088249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:33.088722 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:33.089237 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:33.106208 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:33.162515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:33.164249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:33.240232 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9aa1e-54da-4117-aa1b-d6db628aec17 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:33.267911 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 350/704] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:24:33.273329 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:33.331659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:33.375240 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9aa1e-54da-4117-aa1b-d6db628aec17 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:33.400691 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783688bd-cb70-4ec2-9944-bff04b7c44f7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:33.421143 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:33.421786 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:33.422068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:33.422343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:33.423197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:33.424974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:33.437079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:33.438066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:33.438896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 355/705] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:33.445496 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:33.448926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:33.449109 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:33.450510 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:33.450639 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:33.450996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:33.464458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:33.466755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:33.484203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:33.485216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:33.486111 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:33.486111 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:33.486111 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:33.490163 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 351/706] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:33.492304 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:33.564530 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e323b5-d2bd-471c-abc3-c8786fb203d4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:33.605446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:33.606496 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:33.606980 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:33.607453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:33.608339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:33.608885 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:33.610440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:33.611758 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:33.615724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8a62-fe30-42fe-bd7b-cdc884797067 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:33.621251 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 356/707] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:33.623443 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:33.657522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:33.658070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:33.658305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:33.658584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:33.659227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:33.659532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:33.660914 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:33.676924 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 352/708] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:33.681773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:33.705533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:33.752169 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fdc9a-67c0-48f8-bd5b-50fb3481ead1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:33.799750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:33.800365 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:33.800650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:33.800955 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:33.801856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:33.802168 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:33.804300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:33.816875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 357/709] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:33.817065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940b90-0b3b-493f-a2ef-0d76cfd89155 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:33.857239 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:33.857893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:33.858175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:33.858452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:33.866141 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:33.867614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:33.880281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:33.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:33.882158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:33.886311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 353/710] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:33.887777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:34.007974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62632fc-ca59-451f-b655-a86067238b17 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:34.039203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:34.045661 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce7e61-f26c-4f6c-86c8-6054fa42ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:34.046289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7e61-f26c-4f6c-86c8-6054fa42ec9b None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:34.046766 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7e61-f26c-4f6c-86c8-6054fa42ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:34.047043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7e61-f26c-4f6c-86c8-6054fa42ec9b None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:34.047744 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce7e61-f26c-4f6c-86c8-6054fa42ec9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:34.048055 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce7e61-f26c-4f6c-86c8-6054fa42ec9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:34.049522 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce7e61-f26c-4f6c-86c8-6054fa42ec9b None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:34.064521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 358/711] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:34.068322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:34.089240 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:34.176765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3aeb3-2f06-4830-b644-9fecef0475ee None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:34.212053 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4e67-9681-4ad1-95b6-6442ba6304d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:34.212586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4e67-9681-4ad1-95b6-6442ba6304d7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:34.212894 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4e67-9681-4ad1-95b6-6442ba6304d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:34.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4e67-9681-4ad1-95b6-6442ba6304d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:34.213897 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d4e67-9681-4ad1-95b6-6442ba6304d7 None admin] RBAC: Adding query filter params (role.id=10b54391b6fd4005aadbf0110e20cb50, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=688e9c5a658a4e32a4793d515ed11660) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:34.214211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d4e67-9681-4ad1-95b6-6442ba6304d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:34.215679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d4e67-9681-4ad1-95b6-6442ba6304d7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:34.228989 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 354/712] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:34 2022] GET /identity/v3/role_assignments?user.id=688e9c5a658a4e32a4793d515ed11660&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=10b54391b6fd4005aadbf0110e20cb50 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:34.849221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274d5c7-57f1-4b25-998c-29f2d9f6005e None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:34.849783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274d5c7-57f1-4b25-998c-29f2d9f6005e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:34.849783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274d5c7-57f1-4b25-998c-29f2d9f6005e None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:34.851323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 359/713] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:34.857241 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a3200-29b3-490b-ac68-1b2d35e01af0 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:34.857533 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a3200-29b3-490b-ac68-1b2d35e01af0 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:34.857809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a3200-29b3-490b-ac68-1b2d35e01af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:34.877132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-e19a3200-29b3-490b-ac68-1b2d35e01af0 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:34.878320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e19a3200-29b3-490b-ac68-1b2d35e01af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:34.955690 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 355/714] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:35.019352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e45b0-0bb9-4786-a181-d03da6c2c804 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.019640 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e45b0-0bb9-4786-a181-d03da6c2c804 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.019921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e45b0-0bb9-4786-a181-d03da6c2c804 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.021550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 360/715] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:35.030592 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f87b7a-1840-4e49-9ba9-b9680a70084f None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.031043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f87b7a-1840-4e49-9ba9-b9680a70084f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.031491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f87b7a-1840-4e49-9ba9-b9680a70084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.050973 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-57f87b7a-1840-4e49-9ba9-b9680a70084f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:35.052357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-57f87b7a-1840-4e49-9ba9-b9680a70084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:35.061778 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:35.127559 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 356/716] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:35.232022 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e45b0-0bb9-4786-a181-d03da6c2c804 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.336653 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e45b0-0bb9-4786-a181-d03da6c2c804 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:35.371063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:35.372342 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.372580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.372863 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.373462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:35.374904 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:35.384075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:35.385047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:35.386253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 361/717] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:35.393936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f87b7a-1840-4e49-9ba9-b9680a70084f None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.396528 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.457437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:35.509142 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0a9c-fb76-47a7-8f67-7762346aa8c2 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:35.521709 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f87b7a-1840-4e49-9ba9-b9680a70084f None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:35.549726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:35.550660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.551026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.551392 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.552083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:35.553695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:35.561310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:35.561927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.562208 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.562483 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.563119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:35.563424 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:35.563831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:35.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 00:24:35.565710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:35.566432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:35.566500 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 362/718] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:35.573883 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.575120 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 357/719] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:35.575937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.587499 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:35.695183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea57fa0-0579-4780-b35d-7974e00c37f9 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:35.701853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502c67-dfb8-4f0c-828e-9b2f2d9e6468 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:35.714201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:35.737498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:35.738070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.738353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.738625 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.739257 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:35.739564 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:35.741062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:35.745875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 363/720] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:35.747814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:35.748682 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.749188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.749674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.750571 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:35.751393 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:35.752134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.753471 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:35.759254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 358/721] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:35.766778 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.853163 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:35.884966 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb652de-c81f-4a90-b86d-52fd63f48efa None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:35.897771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83feb20-73f6-4f14-96de-f03e20fd7646 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:35.923949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:35.925077 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.925607 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.926154 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.932433 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:35.932691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:35.936469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:35.941409 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac6ae-13ed-4ae4-9c9c-3fc33defa96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:35.942027 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac6ae-13ed-4ae4-9c9c-3fc33defa96e None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:35.942304 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac6ae-13ed-4ae4-9c9c-3fc33defa96e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:35.942577 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac6ae-13ed-4ae4-9c9c-3fc33defa96e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:35.943244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac6ae-13ed-4ae4-9c9c-3fc33defa96e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:35.944590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac6ae-13ed-4ae4-9c9c-3fc33defa96e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:35.951683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 364/722] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 00:24:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:35.952668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:35.980905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 359/723] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:36.024668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:36.089245 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9865-2c38-4560-be5c-a8b6ef061ce5 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:36.089632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9865-2c38-4560-be5c-a8b6ef061ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:36.089816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9865-2c38-4560-be5c-a8b6ef061ce5 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:36.092283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 360/724] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:24:36.092869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c83bc-d208-4e73-a4ef-085b6a8e329e None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:36.097911 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011e0d-b9e7-4cce-a448-3abc90a22dfc None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:36.098234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011e0d-b9e7-4cce-a448-3abc90a22dfc None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:36.098467 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3011e0d-b9e7-4cce-a448-3abc90a22dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:36.118249 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-a3011e0d-b9e7-4cce-a448-3abc90a22dfc None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:36.119453 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a3011e0d-b9e7-4cce-a448-3abc90a22dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:36.146796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:36.147409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:36.147684 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:36.147951 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:36.148626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:36.150077 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:36.180535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 365/725] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:36.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 361/726] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:36.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:36.515300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d1eb8-f594-415f-bcd0-e07bd65a4691 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:36.515641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d1eb8-f594-415f-bcd0-e07bd65a4691 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:36.515857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d1eb8-f594-415f-bcd0-e07bd65a4691 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:36.517468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 362/727] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:36.522619 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66b58-9644-4c8c-abce-9c4500e1fed0 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:36.522904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66b58-9644-4c8c-abce-9c4500e1fed0 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:36.523183 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66b58-9644-4c8c-abce-9c4500e1fed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:36.549726 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3fd66b58-9644-4c8c-abce-9c4500e1fed0 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:36.551164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3fd66b58-9644-4c8c-abce-9c4500e1fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:36.592797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:36.597225 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe484b-ceb7-45aa-a1a9-4eeefaddd586 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:36.618185 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:36.639578 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:36.640385 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:36.640818 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:36.641220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:36.642002 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:36.643448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:36.645254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 363/728] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:36.664634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 366/729] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:36 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:36.927023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66b58-9644-4c8c-abce-9c4500e1fed0 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:37.040198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66b58-9644-4c8c-abce-9c4500e1fed0 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:37.081996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:37.082627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:37.082904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:37.083172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] PATH_INFO: `/v3/services/image` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:37.083749 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:37.085135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:37.093964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:37.094936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:37.096162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 364/730] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 19 00:24:36 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:37.103408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:37.211694 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582235eb-2337-4fc1-aa9a-0588d3457aea None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:37.248656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e9e9-3231-4235-9799-89291fc4b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:37.249639 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e9e9-3231-4235-9799-89291fc4b823 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:37.250152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e9e9-3231-4235-9799-89291fc4b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:37.250632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e9e9-3231-4235-9799-89291fc4b823 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:37.251462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e9e9-3231-4235-9799-89291fc4b823 None admin] RBAC: Adding query filter params (name=image) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:37.251989 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e9e9-3231-4235-9799-89291fc4b823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:37.253711 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e9e9-3231-4235-9799-89291fc4b823 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:37.262706 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 367/731] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:37.266034 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:37.313572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:37.371198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf140c-8ded-4a85-8907-0eda2fdd7b2a None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:37.406294 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc01c-aaef-40b3-afb1-e7ad78bf1e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:37.406900 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc01c-aaef-40b3-afb1-e7ad78bf1e9c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:37.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc01c-aaef-40b3-afb1-e7ad78bf1e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:37.407450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc01c-aaef-40b3-afb1-e7ad78bf1e9c None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:37.408071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc01c-aaef-40b3-afb1-e7ad78bf1e9c None admin] RBAC: Adding query filter params (type=image) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:37.408372 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc01c-aaef-40b3-afb1-e7ad78bf1e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:37.409744 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc01c-aaef-40b3-afb1-e7ad78bf1e9c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:37.414801 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 365/732] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:38.268068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9042-2098-4ee5-abc5-af3fa3b37a2c None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:38.268556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9042-2098-4ee5-abc5-af3fa3b37a2c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:38.268556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9042-2098-4ee5-abc5-af3fa3b37a2c None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:38.270181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 368/733] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:38.275427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845388d0-a940-47e8-b8a8-f09f5cb054ff None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:38.275849 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845388d0-a940-47e8-b8a8-f09f5cb054ff None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:38.276037 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845388d0-a940-47e8-b8a8-f09f5cb054ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:38.296337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-845388d0-a940-47e8-b8a8-f09f5cb054ff None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:38.297600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-845388d0-a940-47e8-b8a8-f09f5cb054ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:38.374250 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 366/734] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:38.406593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae6ff-459c-4f5c-8052-654ebb20f9a7 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:38.406878 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae6ff-459c-4f5c-8052-654ebb20f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:38.407159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae6ff-459c-4f5c-8052-654ebb20f9a7 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:38.408736 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 369/735] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:38.414183 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322efc0-57a9-4827-a13a-a14ec2f3fe69 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:38.414467 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322efc0-57a9-4827-a13a-a14ec2f3fe69 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:38.414739 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322efc0-57a9-4827-a13a-a14ec2f3fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:38.433393 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-9322efc0-57a9-4827-a13a-a14ec2f3fe69 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:38.434729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9322efc0-57a9-4827-a13a-a14ec2f3fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:38.468145 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:38.510884 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 367/736] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:38.646557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae6ff-459c-4f5c-8052-654ebb20f9a7 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:38.672925 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:38.755300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae6ff-459c-4f5c-8052-654ebb20f9a7 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:38.790744 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:38.791378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:38.791651 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:38.791918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:38.792556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:38.794565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:38.794792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322efc0-57a9-4827-a13a-a14ec2f3fe69 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:38.805602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:38.806618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:38.807444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:38.809025 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 370/737] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:38.813811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:38.924379 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322efc0-57a9-4827-a13a-a14ec2f3fe69 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:38.932098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:38.953526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9ae5d-9477-4536-a67c-697d0ae084cb None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:38.974728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:38.975877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:38.976160 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:38.976433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:38.977429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:38.979701 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:38.983893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING keystone.server.flask.common [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 00:24:38.990831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc4d75-ee91-4b81-8124-2a1c4fdbb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:38.991445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc4d75-ee91-4b81-8124-2a1c4fdbb001 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:38.991726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc4d75-ee91-4b81-8124-2a1c4fdbb001 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:38.991999 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc4d75-ee91-4b81-8124-2a1c4fdbb001 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:38.992625 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc4d75-ee91-4b81-8124-2a1c4fdbb001 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:38.993017 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc4d75-ee91-4b81-8124-2a1c4fdbb001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:38.994388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc4d75-ee91-4b81-8124-2a1c4fdbb001 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.000388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 371/738] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:39.001547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529c466-d415-4ce8-ab65-1f07fce38e2d None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.001848 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529c466-d415-4ce8-ab65-1f07fce38e2d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529c466-d415-4ce8-ab65-1f07fce38e2d None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.007320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 372/739] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:39.007320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529c466-d415-4ce8-ab65-1f07fce38e2d None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.008332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.sql.core [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:24:39.008332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:24:39.008332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [parameters: {'id': 'd1d0b993b6624a52b4b8314c20095a27', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:24:39.008332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81478) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-4b24a805-dbc0-433f-9604-4c14f04f360c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1d0b993b6624a52b4b8314c20095a27.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1d0b993b6624a52b4b8314c20095a27. Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:24:39.016901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result.read() Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:24:39.017872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application yield resource Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise self.value Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application session.commit() Oct 19 00:24:39.018967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:24:39.019853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:24:39.020741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result.read() Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:24:39.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [parameters: {'id': 'd1d0b993b6624a52b4b8314c20095a27', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:39.022433 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:39.023946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1d0b993b6624a52b4b8314c20095a27. Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 368/740] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 19 00:24:38 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548020c5-084d-465b-8f6b-58add3227c40 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.025044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548020c5-084d-465b-8f6b-58add3227c40 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.026155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548020c5-084d-465b-8f6b-58add3227c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.042422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-548020c5-084d-465b-8f6b-58add3227c40 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:39.044514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-548020c5-084d-465b-8f6b-58add3227c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:39.063932 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:39.123094 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 369/741] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:39.123094 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548020c5-084d-465b-8f6b-58add3227c40 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.147221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529c466-d415-4ce8-ab65-1f07fce38e2d None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.195092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.195985 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.196336 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.196683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.197679 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:39.198055 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.201313 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.208881 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 373/742] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:39.214256 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.238899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:39.251270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548020c5-084d-465b-8f6b-58add3227c40 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.288223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.288896 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.289203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.289482 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.297010 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.298619 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:39.310556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:39.311466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:39.312366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:39.316520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 370/743] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:39.317390 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.333308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:39.357572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ebda3-a986-4c73-b601-b6983d9af8b5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.393569 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.394174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.394452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.394751 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.395458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] RBAC: Adding query filter params (interface=admin, service_id=39d8e75930ca43539047978e05a2adec, region_id=RegionOne) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:39.395764 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.397163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.402282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 374/744] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/endpoints?service_id=39d8e75930ca43539047978e05a2adec&interface=admin®ion_id=RegionOne => generated 193 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:39.403080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.446459 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7a053-7990-45f8-9433-770f5d504dc9 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.485193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.486121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.486397 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.486721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.487377 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:39.487697 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.488452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:39.489132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.516864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 371/745] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:39.516864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.517177 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2027421-eee1-426e-a042-a40c084b6edc None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.559390 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.561325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.561608 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.561878 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] PATH_INFO: `/v3/services/compute` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.562488 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.563905 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:39.576970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:39.577998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:39.578811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:39.582532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 375/746] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:39.589266 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.618159 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:39.656218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d02cc-9da1-4305-9d7f-cf2a2641b810 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.696804 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f16be-4b3c-4537-b9b5-c7a3472f5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.697050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f16be-4b3c-4537-b9b5-c7a3472f5fff None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.697420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f16be-4b3c-4537-b9b5-c7a3472f5fff None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.697786 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f16be-4b3c-4537-b9b5-c7a3472f5fff None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.698502 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f16be-4b3c-4537-b9b5-c7a3472f5fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.700933 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f16be-4b3c-4537-b9b5-c7a3472f5fff None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.708953 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 372/747] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/services => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:24:39.710567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94c7a5-ad6f-4ab1-85d0-c20ec94f9e0a None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.710974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94c7a5-ad6f-4ab1-85d0-c20ec94f9e0a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.711337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94c7a5-ad6f-4ab1-85d0-c20ec94f9e0a None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.712754 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 373/748] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:39.718771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e65ff-4278-47d1-a913-2ae27bf0c690 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.719085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e65ff-4278-47d1-a913-2ae27bf0c690 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.719335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e65ff-4278-47d1-a913-2ae27bf0c690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.738277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d717618-ee61-4367-a5c2-f6fd402f4ade None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.739064 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-b33e65ff-4278-47d1-a913-2ae27bf0c690 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:39.740430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-b33e65ff-4278-47d1-a913-2ae27bf0c690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:39.789345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.790382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.790661 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.790929 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.791571 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:39.791873 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.793467 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.799361 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 376/749] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:39.805412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:39.817147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:39.836738 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 374/750] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:39.929622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be466b03-2015-40c6-9b20-5e63dfc75244 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:39.966956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:39.967476 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:39.967760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:39.968038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:39.968675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:39.969005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:39.970367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:39.975729 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 377/751] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:39.982096 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e65ff-4278-47d1-a913-2ae27bf0c690 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:40.052372 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:40.093647 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e65ff-4278-47d1-a913-2ae27bf0c690 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:40.117945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:40.131893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:40.132996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:40.133341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:40.133617 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:40.134361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] RBAC: Adding query filter params (interface=public, service_id=5a04051293eb46b598bbc5d640fa106e, region_id=RegionOne) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:40.134673 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:40.136029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:40.149365 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 375/752] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:24:39 2022] GET /identity/v3/endpoints?service_id=5a04051293eb46b598bbc5d640fa106e&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:40.150605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:40.204215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:40.238479 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d758b-e52a-4ef1-a45a-4591137f9555 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:40.263843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9368e-5afa-4b69-a8ea-1f81acb0e5f0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:40.275060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61794727-cda3-4c8b-a26b-ba90082c702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:40.275689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61794727-cda3-4c8b-a26b-ba90082c702b None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:40.275967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61794727-cda3-4c8b-a26b-ba90082c702b None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:40.276234 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61794727-cda3-4c8b-a26b-ba90082c702b None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:40.276998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61794727-cda3-4c8b-a26b-ba90082c702b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:40.278554 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61794727-cda3-4c8b-a26b-ba90082c702b None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:40.295410 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 378/753] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:40 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:40.300428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:40.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa964d-5bb6-4ab0-963e-31b67edd21f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:40.320724 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa964d-5bb6-4ab0-963e-31b67edd21f9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:40.321294 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa964d-5bb6-4ab0-963e-31b67edd21f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:40.321930 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa964d-5bb6-4ab0-963e-31b67edd21f9 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:40.322726 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa964d-5bb6-4ab0-963e-31b67edd21f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:40.324420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa964d-5bb6-4ab0-963e-31b67edd21f9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:40.333282 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 376/754] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:40 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:24:41.891825 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455991c-f92a-41c5-a7e6-f68f3c4e2cdc None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:41.892385 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455991c-f92a-41c5-a7e6-f68f3c4e2cdc None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:41.892385 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455991c-f92a-41c5-a7e6-f68f3c4e2cdc None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:41.894092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 379/755] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:41.899829 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2c79f-821f-4a58-9c82-81f28ed3749f None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:41.900329 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2c79f-821f-4a58-9c82-81f28ed3749f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:41.900405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2c79f-821f-4a58-9c82-81f28ed3749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:41.920304 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-75f2c79f-821f-4a58-9c82-81f28ed3749f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:41.921910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-75f2c79f-821f-4a58-9c82-81f28ed3749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:41.992993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 377/756] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:41 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:42.001949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948dca-17b5-4653-8aef-7477778a0b6f None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.002506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948dca-17b5-4653-8aef-7477778a0b6f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.002988 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948dca-17b5-4653-8aef-7477778a0b6f None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.005913 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 380/757] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:42.010396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15384f1-61ed-43ce-8607-0081029b8365 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.010917 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15384f1-61ed-43ce-8607-0081029b8365 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.011397 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15384f1-61ed-43ce-8607-0081029b8365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.030198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-c15384f1-61ed-43ce-8607-0081029b8365 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:42.031713 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-c15384f1-61ed-43ce-8607-0081029b8365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:42.105334 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 378/758] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:42 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:42.269727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66948dca-17b5-4653-8aef-7477778a0b6f None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:42.375828 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15384f1-61ed-43ce-8607-0081029b8365 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:42.378443 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66948dca-17b5-4653-8aef-7477778a0b6f None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:42.417425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:42.426573 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:42.427195 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.427470 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.427738 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.428391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:42.430052 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:42.432633 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING keystone.server.flask.common [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 00:24:42.441218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:42.446531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.sql.core [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:24:42.446531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 00:24:42.446531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [parameters: {'user_id': 'b5389d2d1f48425abe089c33e8246357', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 00:24:42.446531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81477) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result.read() Oct 19 00:24:42.456617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:24:42.457550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application yield resource Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise self.value Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application session.commit() Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:24:42.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:24:42.459930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:24:42.460801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application result.read() Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:24:42.461648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b5389d2d1f48425abe089c33e8246357', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:42.462458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 19 00:24:42.464518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 381/759] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 00:24:42 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:42.466987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:42.512785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15384f1-61ed-43ce-8607-0081029b8365 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:42.549615 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907122f-fcfb-447e-a9ff-b3d64f670335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:42.550330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907122f-fcfb-447e-a9ff-b3d64f670335 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.550655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907122f-fcfb-447e-a9ff-b3d64f670335 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.550929 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907122f-fcfb-447e-a9ff-b3d64f670335 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.551504 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907122f-fcfb-447e-a9ff-b3d64f670335 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:42.552985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907122f-fcfb-447e-a9ff-b3d64f670335 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-b907122f-fcfb-447e-a9ff-b3d64f670335 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:42.563211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:42.564323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:42.570512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 379/760] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 00:24:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:42.571687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f453e-4323-47d7-8695-1d61c14c020e None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.571687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f453e-4323-47d7-8695-1d61c14c020e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.571687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f453e-4323-47d7-8695-1d61c14c020e None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.571687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 380/761] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:42.573789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a0b4-2c7e-459a-b48f-b8a2f51bcc5f None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.574063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a0b4-2c7e-459a-b48f-b8a2f51bcc5f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.574329 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a0b4-2c7e-459a-b48f-b8a2f51bcc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.588238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618010af-a46b-4d2f-85c0-be492cfc6691 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:42.596525 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-2385a0b4-2c7e-459a-b48f-b8a2f51bcc5f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:42.597732 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-2385a0b4-2c7e-459a-b48f-b8a2f51bcc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:42.624539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:42.625188 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.625465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.625729 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.633105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:42.634838 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:42.647088 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:42.648203 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:42.649409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 382/762] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:42.650019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:42.666437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 381/763] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:42 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:42.667743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7628ea4-75bd-4708-830e-1e9ffccd1063 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.668038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7628ea4-75bd-4708-830e-1e9ffccd1063 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.668384 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7628ea4-75bd-4708-830e-1e9ffccd1063 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.673011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 382/764] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:42.673011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7628ea4-75bd-4708-830e-1e9ffccd1063 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:42.710147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:42.730394 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:42.765176 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce1785-832f-411b-9ca5-d9e3e2d4cd85 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:42.789765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7628ea4-75bd-4708-830e-1e9ffccd1063 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:42.799447 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8f537-4c1e-43d8-b7ea-1498b7b0660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:42.800113 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f537-4c1e-43d8-b7ea-1498b7b0660b None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.800339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f537-4c1e-43d8-b7ea-1498b7b0660b None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.800605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f537-4c1e-43d8-b7ea-1498b7b0660b None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.801262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8f537-4c1e-43d8-b7ea-1498b7b0660b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:42.801562 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8f537-4c1e-43d8-b7ea-1498b7b0660b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:42.802909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8f537-4c1e-43d8-b7ea-1498b7b0660b None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:42.815806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 383/765] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:42.815806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904c17-ad65-4f96-be8f-f0d4e045e6b0 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.815806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904c17-ad65-4f96-be8f-f0d4e045e6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.815806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904c17-ad65-4f96-be8f-f0d4e045e6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.832489 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-9e904c17-ad65-4f96-be8f-f0d4e045e6b0 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:42.833102 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:42.833800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:42.834002 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9e904c17-ad65-4f96-be8f-f0d4e045e6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:42.834187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:42.834544 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:42.835306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:42.835678 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:42.837198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:42.907365 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 384/766] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:42 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:42.908912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e904c17-ad65-4f96-be8f-f0d4e045e6b0 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:42.973167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:42.987133 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 383/767] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 00:24:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:42.988055 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.051508 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e904c17-ad65-4f96-be8f-f0d4e045e6b0 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.093326 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.094584 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.094912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.095139 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.096128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:43.096441 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.098220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.105310 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 385/768] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 00:24:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:43.111123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.121435 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35cf87-c74f-48a2-b15b-7512c30b6f56 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.124282 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:43.175419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.175419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.175712 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.175945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] PATH_INFO: `/v3/services/image` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.176929 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.178280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:43.190478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:43.191461 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:43.192352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:43.197131 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 384/769] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 19 00:24:42 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:43.197993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.240391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bc010-c407-47f7-bf38-5f47d6e15cb7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.252815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:43.279216 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.279836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.280118 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.281153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.281153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.283410 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.301155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 386/770] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:43.301909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.313451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bd0c8-6661-4936-86ba-6edcf3785172 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.362699 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.363323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.363606 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.363875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.364518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] RBAC: Adding query filter params (name=image) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:43.364816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.366945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.373359 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 385/771] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:43.379085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.409637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:43.424449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f3b6-fc7e-4c26-b0e4-86b3e5bb3301 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.461636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.462400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.462683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.462955 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.463552 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.464994 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:43.474967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:43.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 00:24:43.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:43.480987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 387/772] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:43.482354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.499118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45b27-e624-4bc3-90ca-e8a080e368dd None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.520179 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:43.539078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.539687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.539964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.540235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.540898 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] RBAC: Adding query filter params (type=image) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:43.541191 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.542544 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.547702 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 386/773] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:43.553301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.595568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06876-5390-4d1e-b192-0bf92ed5ae37 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.631408 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.632127 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.632399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.632667 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.633434 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:43.633734 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.635080 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.644994 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 388/774] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:43.646933 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:43.647063 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.658021 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dc38d-cdea-48b4-b9a8-3860906f9717 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.695175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.695455 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.695730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.696524 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] RBAC: Adding query filter params (interface=public, service_id=bc38d13c653c4a1c89ef2ab4626fa767, region_id=RegionOne) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:43.696855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.698215 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.704708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 387/775] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:24:43 2022] GET /identity/v3/endpoints?service_id=bc38d13c653c4a1c89ef2ab4626fa767&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:43.710041 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.744445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:43.749210 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f374b7-9926-470b-870b-6fcac1a13709 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.782610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.783201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.783485 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.783758 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.784381 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:43.784682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.786076 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.791339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 389/776] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 00:24:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:43.797533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:43.825910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc4cf-e0d3-4967-8438-5f55968171b7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.864354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f125a0-a485-4b54-9899-59703a9912fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.864985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f125a0-a485-4b54-9899-59703a9912fb None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.865267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f125a0-a485-4b54-9899-59703a9912fb None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.865644 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f125a0-a485-4b54-9899-59703a9912fb None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.866132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f125a0-a485-4b54-9899-59703a9912fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.867476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f125a0-a485-4b54-9899-59703a9912fb None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.874794 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 388/777] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:24:43 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:24:43.905286 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bdf28-ae7d-4361-83da-61140c937a58 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:43.951490 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333ec1-4549-437a-8b76-3b9a3c3f0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:43.952160 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333ec1-4549-437a-8b76-3b9a3c3f0cc3 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:43.952375 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333ec1-4549-437a-8b76-3b9a3c3f0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:43.952646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333ec1-4549-437a-8b76-3b9a3c3f0cc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:43.953356 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333ec1-4549-437a-8b76-3b9a3c3f0cc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:43.954741 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333ec1-4549-437a-8b76-3b9a3c3f0cc3 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:43.981143 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 390/778] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:24:45.501060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa74e-51b3-4c8b-8d71-6a43f5063c16 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:45.501586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa74e-51b3-4c8b-8d71-6a43f5063c16 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:45.501663 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa74e-51b3-4c8b-8d71-6a43f5063c16 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:45.502995 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 389/779] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:45.508283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab411a5-4e2e-4e53-83e4-cf3e8cb087a9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:45.508656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab411a5-4e2e-4e53-83e4-cf3e8cb087a9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:45.508861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab411a5-4e2e-4e53-83e4-cf3e8cb087a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:45.528048 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-eab411a5-4e2e-4e53-83e4-cf3e8cb087a9 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:45.529343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-eab411a5-4e2e-4e53-83e4-cf3e8cb087a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:45.542908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:45.606396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 391/780] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:45.877491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fa74e-51b3-4c8b-8d71-6a43f5063c16 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:45.897172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:45.995755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fa74e-51b3-4c8b-8d71-6a43f5063c16 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:46.030449 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c0a6-3327-45a7-ab1a-e1d2c27eb3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:46.031082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c0a6-3327-45a7-ab1a-e1d2c27eb3fb None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.031365 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c0a6-3327-45a7-ab1a-e1d2c27eb3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c0a6-3327-45a7-ab1a-e1d2c27eb3fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.032731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0c0a6-3327-45a7-ab1a-e1d2c27eb3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:46.034171 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0c0a6-3327-45a7-ab1a-e1d2c27eb3fb None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:46.035912 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 390/781] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:46.041790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab411a5-4e2e-4e53-83e4-cf3e8cb087a9 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.053756 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4405ca-345a-41af-91fa-82f6ce7c09e9 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.054387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4405ca-345a-41af-91fa-82f6ce7c09e9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.054674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4405ca-345a-41af-91fa-82f6ce7c09e9 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.056001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 391/782] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:24:46.060983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40cc1-5293-4265-a464-0f1af88e952a None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.061269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40cc1-5293-4265-a464-0f1af88e952a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.061536 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40cc1-5293-4265-a464-0f1af88e952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.079714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-5ab40cc1-5293-4265-a464-0f1af88e952a None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:46.080928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-5ab40cc1-5293-4265-a464-0f1af88e952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:46.156962 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 392/783] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:46.157136 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab411a5-4e2e-4e53-83e4-cf3e8cb087a9 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:46.193807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dddf8-17dc-4fd1-9a11-b9557c205439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:46.194414 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dddf8-17dc-4fd1-9a11-b9557c205439 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.194690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dddf8-17dc-4fd1-9a11-b9557c205439 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.194957 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dddf8-17dc-4fd1-9a11-b9557c205439 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.195613 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dddf8-17dc-4fd1-9a11-b9557c205439 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:46.197055 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dddf8-17dc-4fd1-9a11-b9557c205439 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:46.213099 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:46.226155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d20bd3-8b3f-4de7-b82c-4ba4c8c82b83 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.226446 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d20bd3-8b3f-4de7-b82c-4ba4c8c82b83 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.231867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d20bd3-8b3f-4de7-b82c-4ba4c8c82b83 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.232020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 392/784] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:24:46 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:46.232129 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 393/785] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:46.238764 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccadfc6-7b75-4284-81a3-cbf99e8be12e None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.239050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccadfc6-7b75-4284-81a3-cbf99e8be12e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.239323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccadfc6-7b75-4284-81a3-cbf99e8be12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-0ccadfc6-7b75-4284-81a3-cbf99e8be12e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:46.261160 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-0ccadfc6-7b75-4284-81a3-cbf99e8be12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:46.340875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 393/786] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:46.426310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d20bd3-8b3f-4de7-b82c-4ba4c8c82b83 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.445985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:46.534189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d20bd3-8b3f-4de7-b82c-4ba4c8c82b83 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:46.568319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:46.568963 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.569244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.569511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] PATH_INFO: `/v3/services/image` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.570082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:46.571430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:46.580082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:46.581071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:46.581927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 394/787] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 19 00:24:46 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:46.587453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccadfc6-7b75-4284-81a3-cbf99e8be12e None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.610291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.692440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccadfc6-7b75-4284-81a3-cbf99e8be12e None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:46.706404 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:46.719626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:46.729060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:46.729669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.729948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.730224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.731761 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] RBAC: Adding query filter params (name=image) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:46.732072 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:46.733462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:46.733944 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17c3c-59ed-4c93-adcd-b6d45baf2725 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:46.738535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 394/788] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:46.744062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.772375 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:46.773050 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.773327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.773599 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.784565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:46.789567 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:46.790480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:46.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 395/789] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 00:24:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:46.797136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.852302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20ebd-bbd1-4946-9820-f0c5e9ddc9ca None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:46.890274 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:46.890887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.891163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.891451 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.892081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:46.892386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:46.893777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:46.899439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 395/790] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:46.904673 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220fcc-504b-482b-8147-0de0f7c5fc47 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:46.905568 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.943434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:46.943991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:46.944271 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:46.944694 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:46.945314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:46.945550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:46.946903 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:46.956044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 396/791] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 00:24:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:46.961396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:46.964353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:46.973577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:47.021705 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2013b8-bacd-4ca1-ae46-55ff7b1071e9 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:47.057915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:47.058529 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:47.059334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:47.059610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:47.060403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:47.061919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:47.077427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da451b-00b7-4acc-b0ac-e336175aeded None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:47.082877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 396/792] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:24:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:24:47.131665 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:47.132429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:47.132710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:47.133017 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:47.145702 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:47.147184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:47.163791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:47.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:47.165772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:47.165772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:47.165772 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:47.169257 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 397/793] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:47.171521 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:47.282230 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c05cf-6f6f-4af4-86cc-d9d1cdeb7617 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:47.294497 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:47.321314 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:47.322068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:47.322448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:47.322826 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:47.323580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:47.323984 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:47.325524 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:47.338108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 397/794] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:47.344238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:47.396597 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:47.447047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880e898-f8d4-421c-af50-5e8ae6572563 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:47.481033 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:47.481826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:47.482109 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:47.482381 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:47.489801 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:47.491217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:47.503175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:47.504132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:47.505100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 398/795] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 00:24:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:47.511781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:47.613593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d661cb-053c-4d54-af86-adc5e5d8bbbb None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:47.648944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:47.649553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:47.649835 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:47.650106 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:47.650835 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:47.651140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:47.652605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:47.670730 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 398/796] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 00:24:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:47.676388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:47.776437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0819579-746f-4e96-8024-c44809b32b65 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:47.787190 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:47.812646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:47.813302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:47.813584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:47.813859 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:47.824743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:47.826199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:47.849389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:47.850529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:47.851468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:47.851468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:47.851468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:47.851468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 399/797] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:47.857140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:47.886725 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:47.970019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423b25a-b7cb-410a-98aa-afca1611fbb6 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:48.005064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:48.005669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:48.005949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:48.006221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:48.006857 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:48.007159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:48.008506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:48.025008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 399/798] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:48.026708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:48.129466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49e01-ea65-4740-8d9c-46da2b8a4a44 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:48.162777 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:48.163333 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:48.163612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:48.163886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:48.170479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:48.171901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:48.182764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:48.184319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:48.185281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 400/799] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:48.192110 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:48.282455 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:48.297061 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a76fa-e328-4c70-a7c6-c9dc7bbea882 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:48.331021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b6a6-791a-4518-bbfc-9de1464dd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:48.331628 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b6a6-791a-4518-bbfc-9de1464dd230 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:48.331910 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b6a6-791a-4518-bbfc-9de1464dd230 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:48.332182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b6a6-791a-4518-bbfc-9de1464dd230 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:48.332894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b6a6-791a-4518-bbfc-9de1464dd230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:48.333208 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b6a6-791a-4518-bbfc-9de1464dd230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:48.334626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b6a6-791a-4518-bbfc-9de1464dd230 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:48.347185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 400/800] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:48.352822 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:48.382288 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:48.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fed0-4f96-451d-8864-c7ed5473f7cb None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:48.480392 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf12b9-dcdf-447e-99c0-724e3bca5c33 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:48.480737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf12b9-dcdf-447e-99c0-724e3bca5c33 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:48.481120 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf12b9-dcdf-447e-99c0-724e3bca5c33 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:48.482792 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 401/801] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:48.487580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462edd-facf-4b6e-9a37-b593bcef7cef None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:48.487868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462edd-facf-4b6e-9a37-b593bcef7cef None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:48.488209 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462edd-facf-4b6e-9a37-b593bcef7cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:48.503306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:48.503956 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:48.504235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:48.504504 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/a7e3cacb07c94c508868cff854dae659/roles/10b54391b6fd4005aadbf0110e20cb50` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:48.505935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-09462edd-facf-4b6e-9a37-b593bcef7cef None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:48.506745 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=a7e3cacb07c94c508868cff854dae659, role_id=10b54391b6fd4005aadbf0110e20cb50)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:48.507118 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-09462edd-facf-4b6e-9a37-b593bcef7cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:48.508148 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:48.532867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 401/802] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:24:48 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/a7e3cacb07c94c508868cff854dae659/roles/10b54391b6fd4005aadbf0110e20cb50 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:24:48.593294 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 402/803] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:48.870104 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:48.962952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:48.983447 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f129-10f8-498c-89b7-978d20db836d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:49.017591 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601c157-f7d9-4e94-9dc3-81e7e4ea804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:49.018283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c157-f7d9-4e94-9dc3-81e7e4ea804a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:49.018566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c157-f7d9-4e94-9dc3-81e7e4ea804a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:49.018846 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c157-f7d9-4e94-9dc3-81e7e4ea804a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:49.020000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601c157-f7d9-4e94-9dc3-81e7e4ea804a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:49.021463 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601c157-f7d9-4e94-9dc3-81e7e4ea804a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:49.023189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 402/804] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:49.029510 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462edd-facf-4b6e-9a37-b593bcef7cef None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:49.108315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:49.131304 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462edd-facf-4b6e-9a37-b593bcef7cef None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:49.165954 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01f20f-63e7-4111-82ae-0ed801c5ddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:49.166565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01f20f-63e7-4111-82ae-0ed801c5ddb4 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:49.166850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01f20f-63e7-4111-82ae-0ed801c5ddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:49.167124 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01f20f-63e7-4111-82ae-0ed801c5ddb4 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:49.167780 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01f20f-63e7-4111-82ae-0ed801c5ddb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:49.169772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01f20f-63e7-4111-82ae-0ed801c5ddb4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:49.193077 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 403/805] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:24:49 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:24:49.311033 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd2c7-439e-4e35-a132-63a21569d29a None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:49.311395 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd2c7-439e-4e35-a132-63a21569d29a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:49.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd2c7-439e-4e35-a132-63a21569d29a None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:49.316864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 403/806] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:49.318684 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3efd9-d5c5-425b-83cf-6a34fe649db5 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:49.318968 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3efd9-d5c5-425b-83cf-6a34fe649db5 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:49.319235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3efd9-d5c5-425b-83cf-6a34fe649db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:49.338364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-2eb3efd9-d5c5-425b-83cf-6a34fe649db5 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:49.339569 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2eb3efd9-d5c5-425b-83cf-6a34fe649db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:49.415511 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 404/807] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:49.681667 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd2c7-439e-4e35-a132-63a21569d29a None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:49.788648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd2c7-439e-4e35-a132-63a21569d29a None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:49.822079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:49.822954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:49.823375 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:49.823803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:49.825294 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:49.826888 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:49.836852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.sql.core [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:24:49.836852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:24:49.836852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [parameters: {'id': '707facf8d7c443eca9f59a9b683b19f3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:24:49.836852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81478) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:24:49.846197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result.read() Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 00:24:49.847182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application yield resource Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application next(self.gen) Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise self.value Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application session.commit() Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 00:24:49.848338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.session.flush() Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application compat.raise_( Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 00:24:49.849465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:24:49.850564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application conn.query(q) Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application result.read() Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 00:24:49.851515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [parameters: {'id': '707facf8d7c443eca9f59a9b683b19f3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 00:24:49.852631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:49.854440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:49.856366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 404/808] 10.222.0.16 () {60 vars in 1137 bytes} [Wed Oct 19 00:24:49 2022] POST /identity/v3/domains => generated 190 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:49.860433 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3efd9-d5c5-425b-83cf-6a34fe649db5 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:50.039926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:50.081533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3efd9-d5c5-425b-83cf-6a34fe649db5 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:50.118539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e10af-3df9-4e66-95a4-b1b03ecbd78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:50.119204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e10af-3df9-4e66-95a4-b1b03ecbd78b None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:50.119483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e10af-3df9-4e66-95a4-b1b03ecbd78b None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:50.119755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e10af-3df9-4e66-95a4-b1b03ecbd78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:50.131215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e10af-3df9-4e66-95a4-b1b03ecbd78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:50.132671 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e10af-3df9-4e66-95a4-b1b03ecbd78b None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-278e10af-3df9-4e66-95a4-b1b03ecbd78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:50.147740 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:50.148689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:50.150031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:50.150031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:50.150031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:50.150031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 405/809] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:50.155533 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:50.173743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:50.260780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92160fc-4773-4564-8e3d-72857258a7f0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:50.295354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3432e8-7392-4bac-a692-9288c3b386d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:50.295961 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3432e8-7392-4bac-a692-9288c3b386d2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:50.296232 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3432e8-7392-4bac-a692-9288c3b386d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:50.296502 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3432e8-7392-4bac-a692-9288c3b386d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:50.297161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3432e8-7392-4bac-a692-9288c3b386d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:50.297462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3432e8-7392-4bac-a692-9288c3b386d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:50.298809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3432e8-7392-4bac-a692-9288c3b386d2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:50.310020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 405/810] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:50.718670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d275af-9010-4fed-8c3a-65c2538fc706 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:50.718950 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d275af-9010-4fed-8c3a-65c2538fc706 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:50.719221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d275af-9010-4fed-8c3a-65c2538fc706 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:50.720690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 406/811] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:50.725792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4869e-210b-448c-9ad1-88343eaf1730 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:50.726077 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4869e-210b-448c-9ad1-88343eaf1730 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:50.726350 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4869e-210b-448c-9ad1-88343eaf1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:50.744394 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-16e4869e-210b-448c-9ad1-88343eaf1730 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:50.745585 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-16e4869e-210b-448c-9ad1-88343eaf1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:50.810248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 406/812] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:51.074992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d275af-9010-4fed-8c3a-65c2538fc706 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.174698 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d275af-9010-4fed-8c3a-65c2538fc706 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:51.190429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:51.208559 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:51.209209 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.209482 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.209749 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.220535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:51.225184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:51.226135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:51.227379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 407/813] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:51.232549 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4869e-210b-448c-9ad1-88343eaf1730 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.235632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:51.333652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4869e-210b-448c-9ad1-88343eaf1730 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:51.366947 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20b0e-5e13-4a36-8116-ef51c7e24b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:51.367542 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20b0e-5e13-4a36-8116-ef51c7e24b4e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.367816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20b0e-5e13-4a36-8116-ef51c7e24b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.368085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20b0e-5e13-4a36-8116-ef51c7e24b4e None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.368734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f20b0e-5e13-4a36-8116-ef51c7e24b4e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:51.369058 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f20b0e-5e13-4a36-8116-ef51c7e24b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:51.370396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f20b0e-5e13-4a36-8116-ef51c7e24b4e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:51.378305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 407/814] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:51.384051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.406319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71f180-1a5d-41a0-8eed-a81fbb94ada6 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.406602 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71f180-1a5d-41a0-8eed-a81fbb94ada6 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.406878 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71f180-1a5d-41a0-8eed-a81fbb94ada6 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.408200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 408/815] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:24:51.413214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8601f8-4ea0-43a4-9f2d-ec16aef191ab None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.413498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8601f8-4ea0-43a4-9f2d-ec16aef191ab None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.413767 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8601f8-4ea0-43a4-9f2d-ec16aef191ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.431277 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-fe8601f8-4ea0-43a4-9f2d-ec16aef191ab None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:51.432442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-fe8601f8-4ea0-43a4-9f2d-ec16aef191ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:51.484937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fe56-ad91-4b5f-8133-1276e16d3d79 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:51.491426 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:51.499368 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 409/816] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 00:24:51.518231 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:51.518852 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.519127 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.519393 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.529085 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:51.530504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:51.545101 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:51.546161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:51.547288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:51.547288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:51.547288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:51.547288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 408/817] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:51.551696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8601f8-4ea0-43a4-9f2d-ec16aef191ab None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.646624 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8601f8-4ea0-43a4-9f2d-ec16aef191ab None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:51.679538 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:51.680130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.680405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.680672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.681328 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:51.681627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:51.682964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:51.694216 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 410/818] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:51.700588 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.727813 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:51.769079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.800068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71864-e96a-4443-bca1-ca89d1379d0e None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:51.823501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:51.833537 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:51.834150 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.834422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.834690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.841504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:51.842949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:24:51.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:51.855104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:51.856138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 409/819] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:51.860917 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.872099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c884c-2783-4a21-a3cb-ab6b6cc76b94 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:51.904990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:51.905539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.905824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:51.906098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:51.916155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:51.921432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:51.922347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:51.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 411/820] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:51.928332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:51.953007 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:51.965248 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d48799-eeaf-4ca2-98e9-3e5179455d22 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:51.999049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:51.999650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:51.999933 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.000204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.000946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:52.001250 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.002656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.019398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 410/821] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:52.025056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.026552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9a7d3-a518-4dd5-8015-98f50f062b4c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.042639 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:52.061719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.062319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.062600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.062874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.063536 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:52.063843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.065248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.073940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 412/822] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:52.079596 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.125645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65889ff0-819f-45ed-8885-7afef02f2ec2 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.160150 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.161000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.161282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.161561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.176412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:52.177592 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faceb22-72d1-4731-ae1a-0d90a400cd48 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.211612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.211889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.212157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] PATH_INFO: `/v3/users/4a32efc69bbb41b78e62d05c158c8551` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.226291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] RBAC: Authorizing `identity:get_user(user_id=4a32efc69bbb41b78e62d05c158c8551)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.227695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.228168 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.229349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 413/823] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/users/4a32efc69bbb41b78e62d05c158c8551 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:52.229643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.235135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.268428 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:52.327488 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 411/824] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 00:24:52.333211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.333367 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056de3-eb80-4f0b-951c-0d07dc242006 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.368047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.368667 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.368978 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.369255 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] PATH_INFO: `/v3/projects/bba6bb6b66de4300bea0534644517f80` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.370362 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] RBAC: Authorizing `identity:get_project(project_id=bba6bb6b66de4300bea0534644517f80)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.372099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.373889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 414/825] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/projects/bba6bb6b66de4300bea0534644517f80 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:52.379253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:52.379610 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.432924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406655b-b8d0-44c9-b0fa-ccc74c4e5f22 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.466810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.467677 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.467946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.468211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.478066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.479490 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.483153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713be12-0a4d-4021-83a6-faa721a45144 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.485500 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:24:52.495152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:52.496224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:24:52.497111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:24:52.497111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:24:52.497111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:52.497111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 412/826] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:24:52.501891 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.518721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.519374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.519655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.519928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] PATH_INFO: `/v3/projects/bba6bb6b66de4300bea0534644517f80/users/4a32efc69bbb41b78e62d05c158c8551/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.521868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] RBAC: Authorizing `identity:create_grant(project_id=bba6bb6b66de4300bea0534644517f80, user_id=4a32efc69bbb41b78e62d05c158c8551, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.523278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.536238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 415/827] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:24:52 2022] PUT /identity/v3/projects/bba6bb6b66de4300bea0534644517f80/users/4a32efc69bbb41b78e62d05c158c8551/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:24:52.604789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:52.609430 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ae09-283e-4abb-937c-886b04b68daa None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.646216 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.646829 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.647102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.647383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.648012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:52.648315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.649709 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.663296 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 413/828] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:24:52.669889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.770364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee77e-fecc-4472-a530-2a7801c77aee None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.803283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.803909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.804188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.804463 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.811520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.812969 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:24:52.823731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:52.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:24:52.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 416/829] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:52.830769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:52.935415 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b50b8-2a61-4caf-aa9e-d8e3096fe59a None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:52.967219 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dfa79-823b-4d6e-8ec8-67ca9047d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:52.967824 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfa79-823b-4d6e-8ec8-67ca9047d077 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:52.968102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfa79-823b-4d6e-8ec8-67ca9047d077 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:52.968371 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfa79-823b-4d6e-8ec8-67ca9047d077 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:52.969094 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfa79-823b-4d6e-8ec8-67ca9047d077 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:52.969401 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfa79-823b-4d6e-8ec8-67ca9047d077 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:52.970816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfa79-823b-4d6e-8ec8-67ca9047d077 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:52.982609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 414/830] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:52.988933 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:53.014964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:53.088777 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f210-dc36-4f1f-905b-dc3186485580 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:53.123069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f558b0-cc10-4169-b035-520f1eb0f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:53.123665 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f558b0-cc10-4169-b035-520f1eb0f0bf None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:53.123945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f558b0-cc10-4169-b035-520f1eb0f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:53.124217 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f558b0-cc10-4169-b035-520f1eb0f0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:53.124968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f558b0-cc10-4169-b035-520f1eb0f0bf None admin] RBAC: Adding query filter params (role.id=10b54391b6fd4005aadbf0110e20cb50, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=a7e3cacb07c94c508868cff854dae659) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:53.125280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f558b0-cc10-4169-b035-520f1eb0f0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:53.126694 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f558b0-cc10-4169-b035-520f1eb0f0bf None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:53.132455 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 417/831] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:52 2022] GET /identity/v3/role_assignments?user.id=a7e3cacb07c94c508868cff854dae659&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=10b54391b6fd4005aadbf0110e20cb50 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:54.675210 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841333f-4e0a-4a2b-89da-23c49e17492d None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:54.675763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841333f-4e0a-4a2b-89da-23c49e17492d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:54.675763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841333f-4e0a-4a2b-89da-23c49e17492d None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:54.677123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 415/832] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:54.682321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd63f-ac35-4912-be55-d62f3d17a368 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:54.682727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd63f-ac35-4912-be55-d62f3d17a368 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:54.682864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd63f-ac35-4912-be55-d62f3d17a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:54.701787 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-6c7cd63f-ac35-4912-be55-d62f3d17a368 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:54.702947 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6c7cd63f-ac35-4912-be55-d62f3d17a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:54.766446 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 418/833] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:55.035815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841333f-4e0a-4a2b-89da-23c49e17492d None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:55.054874 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:55.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841333f-4e0a-4a2b-89da-23c49e17492d None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:55.166217 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:55.166822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:55.167099 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:55.167369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:55.177620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:24:55.182280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:24:55.183366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:24:55.184884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 416/834] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:24:55.189848 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd63f-ac35-4912-be55-d62f3d17a368 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:55.207338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:55.284631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd63f-ac35-4912-be55-d62f3d17a368 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:55.318063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:55.318663 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:55.318946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:55.319220 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:55.319878 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:55.320181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:55.321560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:55.329379 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 419/835] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:55.335197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:55.410558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:55.431942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cccf80-7d23-47fd-a8e3-789e0ff31bc4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:55.465157 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:55.465780 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:55.466051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:55.466315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] PATH_INFO: `/v3/users/4a32efc69bbb41b78e62d05c158c8551` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:55.467406 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] RBAC: Authorizing `identity:get_user(user_id=4a32efc69bbb41b78e62d05c158c8551)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:55.468806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:55.470354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 417/836] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:24:55 2022] GET /identity/v3/users/4a32efc69bbb41b78e62d05c158c8551 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:55.476048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:55.554698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:55.573122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d78c8-8b8d-4d47-8b2c-e505088f66f7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:55.606630 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:55.607222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:55.607508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:55.607786 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:55.673231 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:55.674655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:55.751470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:55.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 420/837] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:24:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:24:55.776447 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:55.872654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0091bb-2f9a-4c74-b922-8409730022b7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:55.905102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d79b9-c39d-4ee3-9dcf-1ad84d77141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:55.905717 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d79b9-c39d-4ee3-9dcf-1ad84d77141e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:55.905990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d79b9-c39d-4ee3-9dcf-1ad84d77141e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:55.906259 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d79b9-c39d-4ee3-9dcf-1ad84d77141e None admin] PATH_INFO: `/v3/projects/bba6bb6b66de4300bea0534644517f80` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:55.907341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d79b9-c39d-4ee3-9dcf-1ad84d77141e None admin] RBAC: Authorizing `identity:get_project(project_id=bba6bb6b66de4300bea0534644517f80)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:55.908858 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d79b9-c39d-4ee3-9dcf-1ad84d77141e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:55.910442 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 418/838] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:24:55 2022] GET /identity/v3/projects/bba6bb6b66de4300bea0534644517f80 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:55.916825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:56.013906 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d5807-f1e7-4ed1-9624-46df799fe591 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:56.046660 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ebf90-1da4-447b-8b3c-01f4e369e090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:56.047251 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebf90-1da4-447b-8b3c-01f4e369e090 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:56.047531 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebf90-1da4-447b-8b3c-01f4e369e090 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:56.047803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebf90-1da4-447b-8b3c-01f4e369e090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:56.048515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ebf90-1da4-447b-8b3c-01f4e369e090 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=bba6bb6b66de4300bea0534644517f80, user.id=4a32efc69bbb41b78e62d05c158c8551) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:24:56.048823 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ebf90-1da4-447b-8b3c-01f4e369e090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:56.050271 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ebf90-1da4-447b-8b3c-01f4e369e090 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:56.055792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 421/839] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:24:55 2022] GET /identity/v3/role_assignments?user.id=4a32efc69bbb41b78e62d05c158c8551&scope.project.id=bba6bb6b66de4300bea0534644517f80&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:58.198357 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb223e-4859-4d0d-8635-9b8caa1d079a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:58.198865 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb223e-4859-4d0d-8635-9b8caa1d079a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:58.199128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb223e-4859-4d0d-8635-9b8caa1d079a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:58.201155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 419/840] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:24:58.206981 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11699f2-742f-4871-8d5e-0f2bd77f31fd None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:58.207445 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11699f2-742f-4871-8d5e-0f2bd77f31fd None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:58.207538 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11699f2-742f-4871-8d5e-0f2bd77f31fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:58.229270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-e11699f2-742f-4871-8d5e-0f2bd77f31fd None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:24:58.231696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e11699f2-742f-4871-8d5e-0f2bd77f31fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:24:58.274292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:58.303987 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 422/841] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:24:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:24:58.575825 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb223e-4859-4d0d-8635-9b8caa1d079a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:58.592619 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:24:58.675828 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb223e-4859-4d0d-8635-9b8caa1d079a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:58.708475 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2525c8-6b61-41c4-8315-263aff5cc170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:58.709115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2525c8-6b61-41c4-8315-263aff5cc170 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:58.709388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2525c8-6b61-41c4-8315-263aff5cc170 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:58.709652 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2525c8-6b61-41c4-8315-263aff5cc170 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:58.710728 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2525c8-6b61-41c4-8315-263aff5cc170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:58.712129 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2525c8-6b61-41c4-8315-263aff5cc170 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:58.713683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 420/842] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:24:58.720188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11699f2-742f-4871-8d5e-0f2bd77f31fd None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:24:58.815918 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11699f2-742f-4871-8d5e-0f2bd77f31fd None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:24:58.847734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7124754-c017-4d1a-ba84-9a9f59bb7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:24:58.848272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7124754-c017-4d1a-ba84-9a9f59bb7512 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:24:58.848553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7124754-c017-4d1a-ba84-9a9f59bb7512 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:24:58.848828 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7124754-c017-4d1a-ba84-9a9f59bb7512 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:24:58.849493 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7124754-c017-4d1a-ba84-9a9f59bb7512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:24:58.850899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7124754-c017-4d1a-ba84-9a9f59bb7512 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:24:58.872213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 423/843] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:24:58 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:25:01.007550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239401b7-9c46-4199-a1bd-bedc6c29f7b0 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:01.008041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239401b7-9c46-4199-a1bd-bedc6c29f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:01.008128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239401b7-9c46-4199-a1bd-bedc6c29f7b0 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:01.009451 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 421/844] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:01.014811 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fd1e-b088-4a54-a2b1-a64895761fbc None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:01.015234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fd1e-b088-4a54-a2b1-a64895761fbc None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:01.015364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fd1e-b088-4a54-a2b1-a64895761fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:01.033606 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-9661fd1e-b088-4a54-a2b1-a64895761fbc None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:01.034780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9661fd1e-b088-4a54-a2b1-a64895761fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:01.059682 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:01.102002 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 424/845] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:01.366836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239401b7-9c46-4199-a1bd-bedc6c29f7b0 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:01.447104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:01.466198 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239401b7-9c46-4199-a1bd-bedc6c29f7b0 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:01.498945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:01.499561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:01.499841 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:01.500117 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] PATH_INFO: `/v3/roles/f411ad648adf4ef4bb52b64d0f648fff` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:01.501518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] RBAC: Authorizing `identity:get_role(role_id=f411ad648adf4ef4bb52b64d0f648fff)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:01.502870 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:01.504159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 422/846] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:01 2022] GET /identity/v3/roles/f411ad648adf4ef4bb52b64d0f648fff => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:01.509883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661fd1e-b088-4a54-a2b1-a64895761fbc None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:01.605790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661fd1e-b088-4a54-a2b1-a64895761fbc None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:01.640486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:01.641069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:01.641351 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:01.641622 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] PATH_INFO: `/v3/users/fc7187ca5d194749bd9563a140c45e60` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:01.654664 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] RBAC: Authorizing `identity:get_user(user_id=fc7187ca5d194749bd9563a140c45e60)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:01.656095 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:01.657716 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 425/847] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:01 2022] GET /identity/v3/users/fc7187ca5d194749bd9563a140c45e60 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:01.663795 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:01.760810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3838b6-088c-49d4-87e0-b563784afbc8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:01.793201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4ff7c-fba2-4acc-ac66-1c482a60edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:01.793809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4ff7c-fba2-4acc-ac66-1c482a60edca None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:01.794083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4ff7c-fba2-4acc-ac66-1c482a60edca None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:01.794345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4ff7c-fba2-4acc-ac66-1c482a60edca None admin] PATH_INFO: `/v3/projects/bba6bb6b66de4300bea0534644517f80` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:01.795432 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4ff7c-fba2-4acc-ac66-1c482a60edca None admin] RBAC: Authorizing `identity:get_project(project_id=bba6bb6b66de4300bea0534644517f80)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:01.796856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4ff7c-fba2-4acc-ac66-1c482a60edca None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:01.798447 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 423/848] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:25:01 2022] GET /identity/v3/projects/bba6bb6b66de4300bea0534644517f80 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:01.804155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:01.822661 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:01.899504 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a983a-3f1a-4505-b382-b412624874e4 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:01.932732 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a336d2-44e3-4b89-8c17-47d6d710a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:01.932991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a336d2-44e3-4b89-8c17-47d6d710a48f None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:01.933836 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a336d2-44e3-4b89-8c17-47d6d710a48f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:01.934078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a336d2-44e3-4b89-8c17-47d6d710a48f None admin] PATH_INFO: `/v3/projects/bba6bb6b66de4300bea0534644517f80/users/fc7187ca5d194749bd9563a140c45e60/roles/f411ad648adf4ef4bb52b64d0f648fff` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:01.936181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a336d2-44e3-4b89-8c17-47d6d710a48f None admin] RBAC: Authorizing `identity:create_grant(project_id=bba6bb6b66de4300bea0534644517f80, user_id=fc7187ca5d194749bd9563a140c45e60, role_id=f411ad648adf4ef4bb52b64d0f648fff)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:01.937616 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a336d2-44e3-4b89-8c17-47d6d710a48f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:01.951224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 426/849] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:25:01 2022] PUT /identity/v3/projects/bba6bb6b66de4300bea0534644517f80/users/fc7187ca5d194749bd9563a140c45e60/roles/f411ad648adf4ef4bb52b64d0f648fff => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:25:04.091361 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e670-77bf-4bb1-8322-d2bef86ed504 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:04.091922 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e670-77bf-4bb1-8322-d2bef86ed504 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:04.091922 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e670-77bf-4bb1-8322-d2bef86ed504 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:04.093270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 424/850] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:25:04.098455 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96935d-3a13-496c-a2d3-8c810c4e11a6 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:04.098826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96935d-3a13-496c-a2d3-8c810c4e11a6 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:04.099014 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96935d-3a13-496c-a2d3-8c810c4e11a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:04.116880 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-7b96935d-3a13-496c-a2d3-8c810c4e11a6 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:04.118062 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-7b96935d-3a13-496c-a2d3-8c810c4e11a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:04.183006 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 427/851] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:04.460497 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0e670-77bf-4bb1-8322-d2bef86ed504 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:04.479793 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:04.560328 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0e670-77bf-4bb1-8322-d2bef86ed504 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:04.593900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:04.594514 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:04.594789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:04.595059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] PATH_INFO: `/v3/roles/f411ad648adf4ef4bb52b64d0f648fff` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:04.596413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] RBAC: Authorizing `identity:get_role(role_id=f411ad648adf4ef4bb52b64d0f648fff)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:04.597788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:04.599089 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 425/852] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:04 2022] GET /identity/v3/roles/f411ad648adf4ef4bb52b64d0f648fff => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:04.605730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96935d-3a13-496c-a2d3-8c810c4e11a6 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:04.615586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:04.701614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96935d-3a13-496c-a2d3-8c810c4e11a6 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:04.734541 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:04.735103 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:04.735381 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:04.735654 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] PATH_INFO: `/v3/users/fc7187ca5d194749bd9563a140c45e60` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:04.736769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] RBAC: Authorizing `identity:get_user(user_id=fc7187ca5d194749bd9563a140c45e60)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:04.738197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:04.739736 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 428/853] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:04 2022] GET /identity/v3/users/fc7187ca5d194749bd9563a140c45e60 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:04.746409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:04.829205 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:04.843892 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182fab4-c557-4e47-a016-e5e99e7b907e None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:04.876582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:04.877200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:04.877480 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:04.877753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:04.942687 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:04.944111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:05.023870 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:05.039783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 426/854] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:25:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:25:05.046042 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:05.118327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:05.141242 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c6d7b-5775-4e35-a91e-ba32adacb123 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:05.172591 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41017-91d7-4202-a3a4-d44cb9186de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:05.173222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41017-91d7-4202-a3a4-d44cb9186de3 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:05.173500 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41017-91d7-4202-a3a4-d44cb9186de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:05.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41017-91d7-4202-a3a4-d44cb9186de3 None admin] PATH_INFO: `/v3/projects/bba6bb6b66de4300bea0534644517f80` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:05.174857 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea41017-91d7-4202-a3a4-d44cb9186de3 None admin] RBAC: Authorizing `identity:get_project(project_id=bba6bb6b66de4300bea0534644517f80)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:05.176268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea41017-91d7-4202-a3a4-d44cb9186de3 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:05.177867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 429/855] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:25:05 2022] GET /identity/v3/projects/bba6bb6b66de4300bea0534644517f80 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:05.184712 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:05.279714 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b96224-659d-4d53-ab58-74db42cb1a81 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:05.312750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413e905-6cc5-4eff-b26b-531753cde009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:05.313364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e905-6cc5-4eff-b26b-531753cde009 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:05.313646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e905-6cc5-4eff-b26b-531753cde009 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:05.313920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413e905-6cc5-4eff-b26b-531753cde009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:05.314636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413e905-6cc5-4eff-b26b-531753cde009 None admin] RBAC: Adding query filter params (role.id=f411ad648adf4ef4bb52b64d0f648fff, scope.project.id=bba6bb6b66de4300bea0534644517f80, user.id=fc7187ca5d194749bd9563a140c45e60) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:25:05.314946 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413e905-6cc5-4eff-b26b-531753cde009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:05.316354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413e905-6cc5-4eff-b26b-531753cde009 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:05.321920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:25:05 2022] GET /identity/v3/role_assignments?user.id=fc7187ca5d194749bd9563a140c45e60&scope.project.id=bba6bb6b66de4300bea0534644517f80&role.id=f411ad648adf4ef4bb52b64d0f648fff => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:07.427996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cff0d-7e22-429a-91a4-92c3a4e48c84 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:07.428523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cff0d-7e22-429a-91a4-92c3a4e48c84 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:07.428523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cff0d-7e22-429a-91a4-92c3a4e48c84 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:07.429911 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 430/857] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:07.435460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc4dbf-19ca-47e9-8152-b97ef19b91b6 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:07.435875 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc4dbf-19ca-47e9-8152-b97ef19b91b6 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:07.436000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc4dbf-19ca-47e9-8152-b97ef19b91b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:07.454460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-2adc4dbf-19ca-47e9-8152-b97ef19b91b6 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:07.455634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2adc4dbf-19ca-47e9-8152-b97ef19b91b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:07.500133 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:07.520934 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 428/858] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:07.784366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cff0d-7e22-429a-91a4-92c3a4e48c84 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:07.881831 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cff0d-7e22-429a-91a4-92c3a4e48c84 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:07.914366 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70845-d259-46e2-88dd-f700f2d1a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:07.914970 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70845-d259-46e2-88dd-f700f2d1a924 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:07.915244 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70845-d259-46e2-88dd-f700f2d1a924 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:07.915510 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70845-d259-46e2-88dd-f700f2d1a924 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:07.916585 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd70845-d259-46e2-88dd-f700f2d1a924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:07.918532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd70845-d259-46e2-88dd-f700f2d1a924 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:07.920064 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 431/859] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:25:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:07.925791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc4dbf-19ca-47e9-8152-b97ef19b91b6 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:08.020666 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc4dbf-19ca-47e9-8152-b97ef19b91b6 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:08.053398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1b29f-6b0d-4f65-8da2-f0f904afdcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:08.053936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1b29f-6b0d-4f65-8da2-f0f904afdcd7 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:08.054211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1b29f-6b0d-4f65-8da2-f0f904afdcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:08.054488 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1b29f-6b0d-4f65-8da2-f0f904afdcd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:08.055118 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1b29f-6b0d-4f65-8da2-f0f904afdcd7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:08.056526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1b29f-6b0d-4f65-8da2-f0f904afdcd7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:08.082932 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 429/860] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:25:07 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:25:10.235853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd067767-0299-4d31-9e2c-fd0dad69f681 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:10.236377 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd067767-0299-4d31-9e2c-fd0dad69f681 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:10.236377 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd067767-0299-4d31-9e2c-fd0dad69f681 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:10.237791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 432/861] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:10.243045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ffb8-87b9-42ba-bee8-098991a2e16d None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:10.243438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ffb8-87b9-42ba-bee8-098991a2e16d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:10.243590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ffb8-87b9-42ba-bee8-098991a2e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:10.263495 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-92a9ffb8-87b9-42ba-bee8-098991a2e16d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:10.264675 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-92a9ffb8-87b9-42ba-bee8-098991a2e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:10.294427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:10.335589 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 430/862] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:10.613561 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd067767-0299-4d31-9e2c-fd0dad69f681 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:10.628200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:10.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd067767-0299-4d31-9e2c-fd0dad69f681 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:10.745328 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713bf4c-bc57-40c2-961b-36d08b459524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:10.745944 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713bf4c-bc57-40c2-961b-36d08b459524 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:10.746226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713bf4c-bc57-40c2-961b-36d08b459524 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:10.746499 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713bf4c-bc57-40c2-961b-36d08b459524 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:10.747595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713bf4c-bc57-40c2-961b-36d08b459524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:10.749029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713bf4c-bc57-40c2-961b-36d08b459524 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:10.750566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 433/863] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:25:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:10.756341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ffb8-87b9-42ba-bee8-098991a2e16d None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:10.852695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ffb8-87b9-42ba-bee8-098991a2e16d None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:10.885344 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f44ac9-a75a-41eb-84fa-c1edefa5aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:10.886438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44ac9-a75a-41eb-84fa-c1edefa5aa0c None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:10.886725 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44ac9-a75a-41eb-84fa-c1edefa5aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:10.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44ac9-a75a-41eb-84fa-c1edefa5aa0c None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:10.887634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f44ac9-a75a-41eb-84fa-c1edefa5aa0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:10.889067 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f44ac9-a75a-41eb-84fa-c1edefa5aa0c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:10.909311 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 431/864] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:25:10 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:25:13.098571 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277efe-1bc2-4642-adbf-c398d6bebda3 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:13.099137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277efe-1bc2-4642-adbf-c398d6bebda3 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:13.099137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277efe-1bc2-4642-adbf-c398d6bebda3 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:13.100478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 434/865] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:13.105696 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba892e3-ea48-42ab-a08f-5411582fd9cf None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:13.106134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba892e3-ea48-42ab-a08f-5411582fd9cf None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:13.106253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba892e3-ea48-42ab-a08f-5411582fd9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:13.124013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-aba892e3-ea48-42ab-a08f-5411582fd9cf None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:13.125230 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-aba892e3-ea48-42ab-a08f-5411582fd9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:13.138628 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:13.192040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 432/866] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:13.459081 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277efe-1bc2-4642-adbf-c398d6bebda3 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:13.553550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:13.568515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277efe-1bc2-4642-adbf-c398d6bebda3 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:13.607330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:13.607969 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:13.608252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:13.608528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:13.618846 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:25:13.623809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:25:13.624792 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:25:13.629860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 435/867] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:25:13.631093 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba892e3-ea48-42ab-a08f-5411582fd9cf None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:13.731212 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba892e3-ea48-42ab-a08f-5411582fd9cf None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:13.765471 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:13.766086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:13.766360 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:13.766629 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:13.767288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:25:13.767585 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:13.768985 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:13.777901 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 433/868] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:25:13.783673 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:13.883587 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b42d5-8755-4fea-8b36-cbbfc6469a3b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:13.917395 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:13.918010 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:13.918292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:13.918569 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] PATH_INFO: `/v3/users/52e16289b6e741dbbf03b35be40b2fd0` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:13.928407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:13.931440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] RBAC: Authorizing `identity:get_user(user_id=52e16289b6e741dbbf03b35be40b2fd0)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:13.933263 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:13.936315 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 436/869] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:13 2022] GET /identity/v3/users/52e16289b6e741dbbf03b35be40b2fd0 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:13.940648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:13.953626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:14.038785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3036646-8bc4-413c-b6d2-dd1f7883dec8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:14.071105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0556b0-c658-494f-b6dd-d91560eb9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:14.071725 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0556b0-c658-494f-b6dd-d91560eb9cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:14.072007 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0556b0-c658-494f-b6dd-d91560eb9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:14.072282 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0556b0-c658-494f-b6dd-d91560eb9cf5 None admin] PATH_INFO: `/v3/projects/f41e11d42bc7430a8123ac7c2cf17ad0` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:14.074091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0556b0-c658-494f-b6dd-d91560eb9cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=f41e11d42bc7430a8123ac7c2cf17ad0)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:14.075539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0556b0-c658-494f-b6dd-d91560eb9cf5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:14.077173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 434/870] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:25:13 2022] GET /identity/v3/projects/f41e11d42bc7430a8123ac7c2cf17ad0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:14.083017 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:14.177863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57ff5d-9a1a-4c65-85a1-42a37be2a1cf None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:14.210916 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988cdd-63dd-4a91-8bbe-a5d429f3428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:14.211546 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988cdd-63dd-4a91-8bbe-a5d429f3428d None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:14.211826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988cdd-63dd-4a91-8bbe-a5d429f3428d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:14.212092 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988cdd-63dd-4a91-8bbe-a5d429f3428d None admin] PATH_INFO: `/v3/projects/f41e11d42bc7430a8123ac7c2cf17ad0/users/52e16289b6e741dbbf03b35be40b2fd0/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:14.213961 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988cdd-63dd-4a91-8bbe-a5d429f3428d None admin] RBAC: Authorizing `identity:create_grant(project_id=f41e11d42bc7430a8123ac7c2cf17ad0, user_id=52e16289b6e741dbbf03b35be40b2fd0, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:14.215355 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988cdd-63dd-4a91-8bbe-a5d429f3428d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:14.227560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 437/871] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:25:14 2022] PUT /identity/v3/projects/f41e11d42bc7430a8123ac7c2cf17ad0/users/52e16289b6e741dbbf03b35be40b2fd0/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:25:16.367653 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ed4da-afc0-4820-b5d8-cb926fa22073 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:16.368199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ed4da-afc0-4820-b5d8-cb926fa22073 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:16.368199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ed4da-afc0-4820-b5d8-cb926fa22073 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:16.369553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 435/872] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:16.375281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0b72-6811-481f-81d8-e6d80aec2b69 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:16.375695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0b72-6811-481f-81d8-e6d80aec2b69 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:16.375837 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0b72-6811-481f-81d8-e6d80aec2b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:16.393740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-6e9a0b72-6811-481f-81d8-e6d80aec2b69 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:16.394921 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6e9a0b72-6811-481f-81d8-e6d80aec2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:16.447320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:16.460954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 438/873] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:16.732382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ed4da-afc0-4820-b5d8-cb926fa22073 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:16.810142 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:16.832790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ed4da-afc0-4820-b5d8-cb926fa22073 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:16.865937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:16.866550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:16.866831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:16.867104 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:16.877050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:25:16.881753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:25:16.882827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:25:16.883854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 436/874] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:25:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:25:16.889723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0b72-6811-481f-81d8-e6d80aec2b69 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:16.983840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0b72-6811-481f-81d8-e6d80aec2b69 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:17.015751 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:17.016340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:17.016723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:17.017033 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:17.017691 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:25:17.017988 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:17.019328 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:17.027572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 439/875] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:17.033498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:17.131236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af359d0f-4b81-4aac-88e3-6045304cc5b3 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:17.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:17.165329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:17.165612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:17.165886 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] PATH_INFO: `/v3/users/52e16289b6e741dbbf03b35be40b2fd0` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:17.167042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] RBAC: Authorizing `identity:get_user(user_id=52e16289b6e741dbbf03b35be40b2fd0)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:17.168565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:17.170138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 437/876] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:17 2022] GET /identity/v3/users/52e16289b6e741dbbf03b35be40b2fd0 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:17.175769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:17.224043 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:17.272238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25873b-1de7-461d-a52a-01edfe24f8d7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:17.303449 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:17.304035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:17.304310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:17.304578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:17.368146 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:17.369582 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:17.414964 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:17.464527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 440/877] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:25:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:25:17.470401 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:17.479100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:17.570027 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668a6d7-0047-4c90-8a6d-874fea52af35 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:17.602712 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67657bda-671b-4aa4-9872-d3770c5b0d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:17.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657bda-671b-4aa4-9872-d3770c5b0d6a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:17.603602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657bda-671b-4aa4-9872-d3770c5b0d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:17.603871 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657bda-671b-4aa4-9872-d3770c5b0d6a None admin] PATH_INFO: `/v3/projects/f41e11d42bc7430a8123ac7c2cf17ad0` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:17.604985 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67657bda-671b-4aa4-9872-d3770c5b0d6a None admin] RBAC: Authorizing `identity:get_project(project_id=f41e11d42bc7430a8123ac7c2cf17ad0)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:17.606389 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67657bda-671b-4aa4-9872-d3770c5b0d6a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:17.607978 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 438/878] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:25:17 2022] GET /identity/v3/projects/f41e11d42bc7430a8123ac7c2cf17ad0 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:17.614155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:17.709672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a99f4-9f9a-47d3-9ebd-eefbf673c96e None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:17.742690 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47569b4b-5bf8-46e8-9049-3c9da9f1ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:17.743278 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47569b4b-5bf8-46e8-9049-3c9da9f1ab69 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:17.743560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47569b4b-5bf8-46e8-9049-3c9da9f1ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:17.743837 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47569b4b-5bf8-46e8-9049-3c9da9f1ab69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:17.744557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47569b4b-5bf8-46e8-9049-3c9da9f1ab69 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=f41e11d42bc7430a8123ac7c2cf17ad0, user.id=52e16289b6e741dbbf03b35be40b2fd0) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:25:17.744889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47569b4b-5bf8-46e8-9049-3c9da9f1ab69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:17.746378 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47569b4b-5bf8-46e8-9049-3c9da9f1ab69 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:17.752126 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 441/879] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:25:17 2022] GET /identity/v3/role_assignments?user.id=52e16289b6e741dbbf03b35be40b2fd0&scope.project.id=f41e11d42bc7430a8123ac7c2cf17ad0&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:19.894899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ef1e-646f-491d-b7d3-649e496099c3 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:19.895481 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ef1e-646f-491d-b7d3-649e496099c3 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:19.895481 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ef1e-646f-491d-b7d3-649e496099c3 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:19.896754 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 439/880] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:19.902545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076244cd-eb8d-414f-80dd-415375222953 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:19.902980 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076244cd-eb8d-414f-80dd-415375222953 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:19.903078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076244cd-eb8d-414f-80dd-415375222953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:19.921652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-076244cd-eb8d-414f-80dd-415375222953 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:19.922824 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-076244cd-eb8d-414f-80dd-415375222953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:19.931927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:19.989246 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 442/881] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:20.260135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ef1e-646f-491d-b7d3-649e496099c3 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:20.334215 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:20.361789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ef1e-646f-491d-b7d3-649e496099c3 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:20.394196 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614102a-05bb-43b7-8c42-6973174abc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:20.394790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614102a-05bb-43b7-8c42-6973174abc81 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:20.395069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614102a-05bb-43b7-8c42-6973174abc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:20.395339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614102a-05bb-43b7-8c42-6973174abc81 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:20.396006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614102a-05bb-43b7-8c42-6973174abc81 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:20.397392 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614102a-05bb-43b7-8c42-6973174abc81 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:20.413344 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 440/882] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Oct 19 00:25:20 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:25:22.561021 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805c51a-1b56-46b4-8354-fb9d79772f68 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:22.561576 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805c51a-1b56-46b4-8354-fb9d79772f68 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:22.561576 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805c51a-1b56-46b4-8354-fb9d79772f68 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:22.562939 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 443/883] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:22.568397 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355624f-203d-4286-a371-890c5eb61915 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:22.568828 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355624f-203d-4286-a371-890c5eb61915 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:22.568976 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355624f-203d-4286-a371-890c5eb61915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:22.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-a355624f-203d-4286-a371-890c5eb61915 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:22.588881 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-a355624f-203d-4286-a371-890c5eb61915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:22.652753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 441/884] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:22.922405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805c51a-1b56-46b4-8354-fb9d79772f68 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:23.022042 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805c51a-1b56-46b4-8354-fb9d79772f68 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:23.054641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ef2fe-a1db-4c21-bed2-bc3f38f75101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:23.055256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef2fe-a1db-4c21-bed2-bc3f38f75101 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:23.055534 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef2fe-a1db-4c21-bed2-bc3f38f75101 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:23.055807 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef2fe-a1db-4c21-bed2-bc3f38f75101 None admin] PATH_INFO: `/v3/domains/ea66b25552f64151b5e9cf29d6a1a23b` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:23.065935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ef2fe-a1db-4c21-bed2-bc3f38f75101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea66b25552f64151b5e9cf29d6a1a23b)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:23.067354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ef2fe-a1db-4c21-bed2-bc3f38f75101 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:23.068937 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 444/885] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 19 00:25:22 2022] GET /identity/v3/domains/ea66b25552f64151b5e9cf29d6a1a23b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:23.074952 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355624f-203d-4286-a371-890c5eb61915 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:23.133797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:23.171565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355624f-203d-4286-a371-890c5eb61915 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:23.203633 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c51183-a1e3-4408-9fee-8a93fd9782c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:23.204175 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c51183-a1e3-4408-9fee-8a93fd9782c4 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:23.204449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c51183-a1e3-4408-9fee-8a93fd9782c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:23.204719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c51183-a1e3-4408-9fee-8a93fd9782c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:23.205388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c51183-a1e3-4408-9fee-8a93fd9782c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:23.206801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c51183-a1e3-4408-9fee-8a93fd9782c4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:23.233984 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 442/886] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:25:23 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:25:25.402719 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291543-529d-42e8-bdb8-17f3c8f8564b None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:25.403273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291543-529d-42e8-bdb8-17f3c8f8564b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:25.403273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291543-529d-42e8-bdb8-17f3c8f8564b None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:25.404582 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 445/887] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:25.409774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ecd3-82fe-4eb6-8451-2153506516c4 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:25.410199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ecd3-82fe-4eb6-8451-2153506516c4 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:25.410333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ecd3-82fe-4eb6-8451-2153506516c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:25.429109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4532ecd3-82fe-4eb6-8451-2153506516c4 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:25.430288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4532ecd3-82fe-4eb6-8451-2153506516c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:25.494445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 443/888] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:25.765660 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4291543-529d-42e8-bdb8-17f3c8f8564b None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:25.769427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:25.864995 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4291543-529d-42e8-bdb8-17f3c8f8564b None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:25.897260 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2322af-7c7d-415e-af20-2e499fdbfe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:25.897874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2322af-7c7d-415e-af20-2e499fdbfe85 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:25.898154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2322af-7c7d-415e-af20-2e499fdbfe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:25.898425 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2322af-7c7d-415e-af20-2e499fdbfe85 None admin] PATH_INFO: `/v3/domains/ea66b25552f64151b5e9cf29d6a1a23b` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:25.899518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2322af-7c7d-415e-af20-2e499fdbfe85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea66b25552f64151b5e9cf29d6a1a23b)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:25.901002 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2322af-7c7d-415e-af20-2e499fdbfe85 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:25.902535 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 446/889] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 19 00:25:25 2022] GET /identity/v3/domains/ea66b25552f64151b5e9cf29d6a1a23b => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:25.908336 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532ecd3-82fe-4eb6-8451-2153506516c4 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:25.953936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:26.006327 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532ecd3-82fe-4eb6-8451-2153506516c4 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:26.039219 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de286ea-4a9a-4f3e-9d80-137a453460fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:26.039811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de286ea-4a9a-4f3e-9d80-137a453460fc None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:26.040087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de286ea-4a9a-4f3e-9d80-137a453460fc None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:26.040354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de286ea-4a9a-4f3e-9d80-137a453460fc None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:26.041032 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de286ea-4a9a-4f3e-9d80-137a453460fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:26.043374 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de286ea-4a9a-4f3e-9d80-137a453460fc None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:26.064567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 444/890] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:25:25 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:25:28.288817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0cb19-9236-451c-960b-9de272c4171a None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:28.289491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0cb19-9236-451c-960b-9de272c4171a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:28.289491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0cb19-9236-451c-960b-9de272c4171a None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:28.290730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 447/891] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:28.296100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd011cc-9135-4689-aafd-faacfd3477f2 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:28.296505 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd011cc-9135-4689-aafd-faacfd3477f2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:28.296653 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd011cc-9135-4689-aafd-faacfd3477f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:28.314903 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-5dd011cc-9135-4689-aafd-faacfd3477f2 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:28.316083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-5dd011cc-9135-4689-aafd-faacfd3477f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:28.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 445/892] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:28.655338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0cb19-9236-451c-960b-9de272c4171a None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:28.723701 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:28.753091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0cb19-9236-451c-960b-9de272c4171a None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:28.786305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:28.787180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:28.787464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:28.787732 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:28.797757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:25:28.802511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:25:28.803655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:25:28.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 448/893] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:25:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:25:28.810336 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd011cc-9135-4689-aafd-faacfd3477f2 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:28.840776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:28.907782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd011cc-9135-4689-aafd-faacfd3477f2 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:28.941437 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:28.942039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:28.942315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:28.942580 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:28.943236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:25:28.943531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:28.944908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:28.953569 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 446/894] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:25:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:28.959299 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:29.054520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca2bd6-fc88-49e5-9873-e0ad447520f4 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:29.082920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:29.088069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:29.088693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:29.089006 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:29.089280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] PATH_INFO: `/v3/users/1dbd7105dae348e8ba05a49f168169bc` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:29.102402 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] RBAC: Authorizing `identity:get_user(user_id=1dbd7105dae348e8ba05a49f168169bc)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:29.103826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:29.105816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 449/895] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:28 2022] GET /identity/v3/users/1dbd7105dae348e8ba05a49f168169bc => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:29.111487 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:29.202085 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:29.208959 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2735e-dc8a-4408-9985-ae64ee556e13 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:29.241220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ad4e4-f8cf-498c-a6fc-b2346669852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:29.241828 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad4e4-f8cf-498c-a6fc-b2346669852d None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:29.242102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad4e4-f8cf-498c-a6fc-b2346669852d None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:29.242373 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad4e4-f8cf-498c-a6fc-b2346669852d None admin] PATH_INFO: `/v3/projects/dd5fb7f14d254f6e980887a1a3767dc6` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:29.243460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ad4e4-f8cf-498c-a6fc-b2346669852d None admin] RBAC: Authorizing `identity:get_project(project_id=dd5fb7f14d254f6e980887a1a3767dc6)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:29.245465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ad4e4-f8cf-498c-a6fc-b2346669852d None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:29.247058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 447/896] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:25:29 2022] GET /identity/v3/projects/dd5fb7f14d254f6e980887a1a3767dc6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:29.253107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:29.347751 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3328-4d51-4f74-bbf2-51f514c555ea None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:29.381302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1424ba7-a73a-4085-9f07-91a01298d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:29.381934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1424ba7-a73a-4085-9f07-91a01298d11e None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:29.382210 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1424ba7-a73a-4085-9f07-91a01298d11e None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:29.382479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1424ba7-a73a-4085-9f07-91a01298d11e None admin] PATH_INFO: `/v3/projects/dd5fb7f14d254f6e980887a1a3767dc6/users/1dbd7105dae348e8ba05a49f168169bc/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:29.384337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1424ba7-a73a-4085-9f07-91a01298d11e None admin] RBAC: Authorizing `identity:create_grant(project_id=dd5fb7f14d254f6e980887a1a3767dc6, user_id=1dbd7105dae348e8ba05a49f168169bc, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:29.385798 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1424ba7-a73a-4085-9f07-91a01298d11e None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:29.397610 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 450/897] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:25:29 2022] PUT /identity/v3/projects/dd5fb7f14d254f6e980887a1a3767dc6/users/1dbd7105dae348e8ba05a49f168169bc/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:25:31.481551 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c37b8-b9d4-4fec-bb0b-720007d60bde None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:31.482078 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c37b8-b9d4-4fec-bb0b-720007d60bde None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:31.482078 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c37b8-b9d4-4fec-bb0b-720007d60bde None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:31.483412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 448/898] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:25:31.488803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f28b4e-9732-46e3-8ed1-eed382e55069 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:31.489196 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f28b4e-9732-46e3-8ed1-eed382e55069 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:31.489383 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f28b4e-9732-46e3-8ed1-eed382e55069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:31.507252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-14f28b4e-9732-46e3-8ed1-eed382e55069 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:25:31.508426 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-14f28b4e-9732-46e3-8ed1-eed382e55069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:25:31.554027 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:31.575388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 451/899] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:25:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:25:31.845403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c37b8-b9d4-4fec-bb0b-720007d60bde None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:31.943622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c37b8-b9d4-4fec-bb0b-720007d60bde None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:31.977253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:31.977860 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:31.978132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:31.978401 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:31.988058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:25:31.992670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:25:31.993757 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:25:31.995299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:25:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:25:32.000197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f28b4e-9732-46e3-8ed1-eed382e55069 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:32.096759 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f28b4e-9732-46e3-8ed1-eed382e55069 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:32.129843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:32.130440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:32.130722 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:32.130996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:32.131649 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:25:32.131960 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:32.133344 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:32.141825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 452/901] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:25:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:32.147646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:32.172421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:32.245153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811cd7-8171-4359-8263-fddb32245d5c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:32.277384 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:32.277986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:32.278262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:32.278530 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] PATH_INFO: `/v3/users/1dbd7105dae348e8ba05a49f168169bc` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:32.279624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] RBAC: Authorizing `identity:get_user(user_id=1dbd7105dae348e8ba05a49f168169bc)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:32.281061 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:32.282605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 450/902] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 00:25:32 2022] GET /identity/v3/users/1dbd7105dae348e8ba05a49f168169bc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:32.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:32.331268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:32.386686 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c183563-76b6-4c5a-be66-1fd9776f438f None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:32.419101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:32.419696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:32.419979 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:32.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:32.486290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:32.487715 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:32.527855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:32.582661 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 453/903] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:25:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:25:32.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:32.676764 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:32.686908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6222f2-9928-464c-9018-486ac40385f4 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:32.719174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23e7e-349d-4cdb-8827-b2bd65f6ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:32.719782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23e7e-349d-4cdb-8827-b2bd65f6ec73 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:32.720060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23e7e-349d-4cdb-8827-b2bd65f6ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:32.720331 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23e7e-349d-4cdb-8827-b2bd65f6ec73 None admin] PATH_INFO: `/v3/projects/dd5fb7f14d254f6e980887a1a3767dc6` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:32.721440 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d23e7e-349d-4cdb-8827-b2bd65f6ec73 None admin] RBAC: Authorizing `identity:get_project(project_id=dd5fb7f14d254f6e980887a1a3767dc6)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:32.722856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d23e7e-349d-4cdb-8827-b2bd65f6ec73 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:32.724449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 451/904] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 00:25:32 2022] GET /identity/v3/projects/dd5fb7f14d254f6e980887a1a3767dc6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:32.730636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:25:32.826722 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff351a-2d54-4ae1-bb02-26265c17b6e0 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:25:32.858323 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85855c-c4ab-40b7-9c66-b0284e4d7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:25:32.858909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85855c-c4ab-40b7-9c66-b0284e4d7088 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:25:32.859187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85855c-c4ab-40b7-9c66-b0284e4d7088 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:25:32.859454 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85855c-c4ab-40b7-9c66-b0284e4d7088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:25:32.860162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85855c-c4ab-40b7-9c66-b0284e4d7088 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=dd5fb7f14d254f6e980887a1a3767dc6, user.id=1dbd7105dae348e8ba05a49f168169bc) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:25:32.860468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85855c-c4ab-40b7-9c66-b0284e4d7088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:25:32.861899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85855c-c4ab-40b7-9c66-b0284e4d7088 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:25:32.867411 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 454/905] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:25:32 2022] GET /identity/v3/role_assignments?user.id=1dbd7105dae348e8ba05a49f168169bc&scope.project.id=dd5fb7f14d254f6e980887a1a3767dc6&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:25:42.715251 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=21 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:25:42.864861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:28.599185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef30e86-9238-4436-a96b-60446fc08d90 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:28.599185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef30e86-9238-4436-a96b-60446fc08d90 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:28.599185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef30e86-9238-4436-a96b-60446fc08d90 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:28.599185 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 452/906] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:28.605934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ef32-7613-4f16-b329-336e37f51219 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:28.606443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ef32-7613-4f16-b329-336e37f51219 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:28.606603 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ef32-7613-4f16-b329-336e37f51219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:28.630745 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-1dc9ef32-7613-4f16-b329-336e37f51219 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:28.632124 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-1dc9ef32-7613-4f16-b329-336e37f51219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:28.725046 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 455/907] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:28.999447 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef30e86-9238-4436-a96b-60446fc08d90 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.118287 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef30e86-9238-4436-a96b-60446fc08d90 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.158280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.158977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.159189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.159460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.171643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.173140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:29.189627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:29.191622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:29.193562 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:29.193562 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:29.193562 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:29.193562 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 453/908] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:29.199143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ef32-7613-4f16-b329-336e37f51219 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.325790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ef32-7613-4f16-b329-336e37f51219 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.363095 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.372287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240a22f-2fbf-4e46-97fd-157d969e69f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.373166 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240a22f-2fbf-4e46-97fd-157d969e69f2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.373620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240a22f-2fbf-4e46-97fd-157d969e69f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.374132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240a22f-2fbf-4e46-97fd-157d969e69f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.374932 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240a22f-2fbf-4e46-97fd-157d969e69f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:29.375194 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240a22f-2fbf-4e46-97fd-157d969e69f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.376574 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240a22f-2fbf-4e46-97fd-157d969e69f2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.392881 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 456/909] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:29.395674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:29.467791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:29.547595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f899-b557-44cd-85ed-d79b0b8e7998 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:29.593186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f219c90-c779-47f6-a98f-0ce2ec5f188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:29.593186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219c90-c779-47f6-a98f-0ce2ec5f188e None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:29.593186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219c90-c779-47f6-a98f-0ce2ec5f188e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:29.593186 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219c90-c779-47f6-a98f-0ce2ec5f188e None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:29.593673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f219c90-c779-47f6-a98f-0ce2ec5f188e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:29.593673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f219c90-c779-47f6-a98f-0ce2ec5f188e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:29.620969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 454/910] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 00:26:29 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:32.238289 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098a43-d4c5-4d0f-8d1a-e508b9a95fbe None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.238835 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098a43-d4c5-4d0f-8d1a-e508b9a95fbe None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.238835 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098a43-d4c5-4d0f-8d1a-e508b9a95fbe None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.240348 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 457/911] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:32.245952 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca83a-7843-49b8-8eb7-6f800c1ec4fc None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.247370 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca83a-7843-49b8-8eb7-6f800c1ec4fc None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.247370 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca83a-7843-49b8-8eb7-6f800c1ec4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.267536 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-63fca83a-7843-49b8-8eb7-6f800c1ec4fc None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:32.268817 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-63fca83a-7843-49b8-8eb7-6f800c1ec4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:32.348876 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 455/912] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:32.623894 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3098a43-d4c5-4d0f-8d1a-e508b9a95fbe None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:32.756886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3098a43-d4c5-4d0f-8d1a-e508b9a95fbe None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:32.796765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:32.797492 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:32.797781 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:32.798063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:32.809664 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:32.814528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:32.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:32.816501 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 458/913] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:26:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:32.822689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca83a-7843-49b8-8eb7-6f800c1ec4fc None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:32.887668 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:32.960018 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca83a-7843-49b8-8eb7-6f800c1ec4fc None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.002325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.002943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.003220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.003491 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.004189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] RBAC: Adding query filter params (name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:33.004482 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.005882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.014663 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 456/914] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:26:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.020640 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.077813 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.141172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819dd11-cb18-45a9-81af-f17c07b1a857 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.185800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.186540 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.186981 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.187362 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.201080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.202543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:33.219886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:33.222302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:33.223392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:33.223392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:33.223392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:33.223392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 459/915] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:33.228082 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.354554 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dcba8-3ffa-4866-a0e5-01a3794d095f None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.356155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.397945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.399150 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.399590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.399871 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.400758 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:33.401699 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.402850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.417783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 457/916] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:33.423311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.549063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d4b03-696f-4aab-845d-e78011ec30b2 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.550612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:33.593434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.594079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.594454 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.594713 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.606100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.608126 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:26:33.623031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:33.624022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:33.625434 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:33.630340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 460/917] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:33.630470 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.759622 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49aba2-ea81-40e2-bdb6-8d472297cd29 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.796792 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.797666 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.797981 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:33.799083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:33.799395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:33.800983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:33.819945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 458/918] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:33.825552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:33.950636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9d798-eb5b-43cf-879f-158a0e7d108f None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:33.987189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:33.987839 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:33.988119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:33.988394 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.000587 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.002123 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:34.018118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:34.019157 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:34.020070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:34.020070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:34.020070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:34.024335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 461/919] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:34.025298 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.045983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.155522 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff5a37-e2c1-4b63-b332-e7b955373101 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.197516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.198233 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.198514 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.198785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.199432 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:34.199765 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.201127 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.214726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 459/920] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:34.219544 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.238587 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.358934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd5474-f77b-4f90-9a3a-82cae7187f5c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.394911 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.395534 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.395811 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.396080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.402700 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.404324 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:26:34.417723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:34.418817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:34.419879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 462/921] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:34.426787 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.512749 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.541785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed7a60-9b25-4a95-acae-9c23db8b92f5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.583429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aef29b-87c0-426b-9fbc-9dbe9c102a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.584041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aef29b-87c0-426b-9fbc-9dbe9c102a50 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.584317 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aef29b-87c0-426b-9fbc-9dbe9c102a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.584592 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aef29b-87c0-426b-9fbc-9dbe9c102a50 None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.585312 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aef29b-87c0-426b-9fbc-9dbe9c102a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:34.585618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aef29b-87c0-426b-9fbc-9dbe9c102a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.588110 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aef29b-87c0-426b-9fbc-9dbe9c102a50 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.604746 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 460/922] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:26:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:34.611803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:34.696254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:34.724041 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306588a-0662-4e66-9f07-1221580d9a8d None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:34.764893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df3e57-8e7e-4c7c-b6db-9257d6e97dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:34.766087 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3e57-8e7e-4c7c-b6db-9257d6e97dfe None admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:34.766608 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3e57-8e7e-4c7c-b6db-9257d6e97dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:34.767199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df3e57-8e7e-4c7c-b6db-9257d6e97dfe None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/6812489400ac43578d5941fa839f71c3/roles/4a5095badf5d4f6d9ef9d87f26f043eb` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:34.787314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df3e57-8e7e-4c7c-b6db-9257d6e97dfe None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=6812489400ac43578d5941fa839f71c3, role_id=4a5095badf5d4f6d9ef9d87f26f043eb)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:34.788775 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df3e57-8e7e-4c7c-b6db-9257d6e97dfe None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:34.803230 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 463/923] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:34 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/6812489400ac43578d5941fa839f71c3/roles/4a5095badf5d4f6d9ef9d87f26f043eb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:37.265273 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07a022-281a-481e-9c46-d0d902226cbf None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.265791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07a022-281a-481e-9c46-d0d902226cbf None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.265791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07a022-281a-481e-9c46-d0d902226cbf None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.267448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 461/924] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:37.272526 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62dfd0-2804-4c50-a9db-021e8657a334 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.272979 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62dfd0-2804-4c50-a9db-021e8657a334 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.273175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62dfd0-2804-4c50-a9db-021e8657a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.294332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-5d62dfd0-2804-4c50-a9db-021e8657a334 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:37.295581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-5d62dfd0-2804-4c50-a9db-021e8657a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:37.367060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 464/925] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:37.666961 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07a022-281a-481e-9c46-d0d902226cbf None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:37.791943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07a022-281a-481e-9c46-d0d902226cbf None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:37.831919 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:37.832586 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:37.832936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:37.833212 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:37.842504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:37.847499 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:37.853201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:37.854465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:37.858132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 462/926] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 00:26:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:37.861558 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62dfd0-2804-4c50-a9db-021e8657a334 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:37.928268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:37.981260 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62dfd0-2804-4c50-a9db-021e8657a334 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:38.018940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:38.019652 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.019954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.020268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.021152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] RBAC: Adding query filter params (name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:38.021508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:38.023091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:38.032491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 465/927] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 00:26:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:38.038770 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:38.150370 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eae36-cd36-427e-8e9d-cb0ac9298bad None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:38.190604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:38.191159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.191500 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.191777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.205361 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:38.207046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:38.227333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:38.228337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:38.229265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:38.229265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:38.229265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:38.229265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 463/928] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:38.234504 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:38.342476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd501d-24d2-4d9f-ae7c-7693871cb502 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:38.361137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:38.380905 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:38.381538 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.381855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.382187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.383636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:38.383768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:38.385227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:38.397460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 466/929] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:38.403736 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:38.455252 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:38.512163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3179ac-43dc-4b51-86e8-f01ccab59c29 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:38.556064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:38.556697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.557006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.557277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.565438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:38.566880 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:26:38.579192 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:38.585611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:38.587081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 464/930] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:38.587786 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:38.709057 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa511b-ab7c-462f-a5bf-7ccdcdaf5778 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:38.748312 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:38.748991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.749324 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.749609 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:38.750384 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:38.750696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:38.752119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:38.772052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 467/931] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 00:26:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:38.778429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:38.895428 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4d3a-0f44-4fbe-9966-544af33728e1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:38.907189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:38.937920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:38.938531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:38.938807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:38.939075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.014131 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.015569 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.135942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 465/932] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:26:39.141861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.178300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.253206 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1e01-a246-43b6-9c8a-b45f57160cd7 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.293214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.293864 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.294143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.294414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.304891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.306443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:39.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:39.326309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:39.327494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:39.327494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:39.327494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:39.327494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 468/933] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 00:26:39.332779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.345091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.436243 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8966e3-6620-437d-8521-80634ed9dad7 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.473756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.474362 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.474642 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.474916 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.475557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:39.475878 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.477565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.492489 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 466/934] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:26:39.498474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.595933 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.616656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd97a81-2a41-4758-8763-f1919fd3b846 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.660039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.660668 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.660979 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.661230 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.669808 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.671306 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:26:39.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:39.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:39.685773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 469/935] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:39.690695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.776386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:39.811500 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06097c9d-7456-48fd-9839-668edfef35a5 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:39.848527 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0475d7-0c93-43e3-ad8d-9029486b582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:39.849380 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0475d7-0c93-43e3-ad8d-9029486b582c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:39.849923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0475d7-0c93-43e3-ad8d-9029486b582c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:39.850209 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0475d7-0c93-43e3-ad8d-9029486b582c None admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:39.851023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0475d7-0c93-43e3-ad8d-9029486b582c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:39.851945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0475d7-0c93-43e3-ad8d-9029486b582c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:39.853769 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0475d7-0c93-43e3-ad8d-9029486b582c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:39.866413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 467/936] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:39.873099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:39.983269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2094f9-8b7e-4238-8176-31e850f40d3b None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:40.019618 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4cd36-c73b-4076-b026-ecb73701b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:40.020233 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4cd36-c73b-4076-b026-ecb73701b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:40.020514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4cd36-c73b-4076-b026-ecb73701b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:40.020790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4cd36-c73b-4076-b026-ecb73701b9e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:40.021551 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4cd36-c73b-4076-b026-ecb73701b9e4 None admin] RBAC: Adding query filter params (role.id=4a5095badf5d4f6d9ef9d87f26f043eb, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=6812489400ac43578d5941fa839f71c3) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:40.021851 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4cd36-c73b-4076-b026-ecb73701b9e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:40.023322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4cd36-c73b-4076-b026-ecb73701b9e4 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:40.029176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 470/937] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:39 2022] GET /identity/v3/role_assignments?user.id=6812489400ac43578d5941fa839f71c3&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=4a5095badf5d4f6d9ef9d87f26f043eb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:42.333250 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e6c0-3bd1-4486-85ee-d30415eb6c5a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.333816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e6c0-3bd1-4486-85ee-d30415eb6c5a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.333816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e6c0-3bd1-4486-85ee-d30415eb6c5a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.335452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 468/938] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:42.341826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd325-3820-4ea4-9d86-500a94770523 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.342251 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd325-3820-4ea4-9d86-500a94770523 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.342514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bd325-3820-4ea4-9d86-500a94770523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.363341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-692bd325-3820-4ea4-9d86-500a94770523 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:42.364665 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-692bd325-3820-4ea4-9d86-500a94770523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:42.367875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:42.442994 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 471/939] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:42.749982 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1e6c0-3bd1-4486-85ee-d30415eb6c5a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:42.866050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1e6c0-3bd1-4486-85ee-d30415eb6c5a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:42.898770 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:42.905882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:42.906572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:42.906912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:42.907253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:42.919929 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:42.925265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:42.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:42.930059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 469/940] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:42.933238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd325-3820-4ea4-9d86-500a94770523 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.043063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bd325-3820-4ea4-9d86-500a94770523 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.082178 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.082768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.083060 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.083325 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.083998 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:43.084302 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.085845 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.094904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 472/941] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:43.100721 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.210300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850f4e-a6d6-410d-9b56-7f476830e890 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.247241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.247914 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.248217 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.248494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.260628 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.262149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:43.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:43.278349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:43.279260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:43.279260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:43.279260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:43.279260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 470/942] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:43.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:43.390267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde9f58-dbab-438f-8d32-94b4c323df33 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.427671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.428280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.428563 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.428855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.430090 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:43.430399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.431875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.446620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 473/943] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:43.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.502688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:43.563729 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5df5d-39eb-4427-bcf2-af4d4e32b322 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.602553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.603311 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.603656 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.603991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.613820 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.615605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:26:43.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:43.629221 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:43.630354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 471/944] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:43.635855 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.705181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:43.745704 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20702b6-0735-4ec9-b87e-b32abe0be90c None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.782180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.782810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.783070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.783402 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.784125 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:43.784431 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.785877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:43.804104 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 474/945] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 00:26:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:43.810079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:43.925809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c09bd-af82-4d0f-b3cc-a98196ceb63a None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:43.927379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:43.967358 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:43.968041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:43.968388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:43.968666 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:43.982690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:43.984131 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:44.000618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:44.003023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:44.004097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:44.004097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:44.004097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:44.004097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 472/946] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:44.007423 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:44.115069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b243e-e353-417e-afc5-7f64a25936c3 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:44.137897 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:44.153295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:44.153897 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:44.154176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:44.154452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:44.155094 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:44.155400 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:44.156769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:44.169705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 475/947] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:44.175828 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:44.277812 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f4c24-6804-4389-8439-a5982ec4cdd8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:44.314874 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:44.315510 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:44.315786 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:44.316059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:44.322986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:44.324443 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:26:44.336572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:44.337723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:44.339074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 473/948] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:44.343996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:44.454031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9016-269d-4e44-8d0d-af0a14a5f684 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:44.493234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c5069-5b94-4b28-aaeb-5ae6c050b842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:44.493845 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5069-5b94-4b28-aaeb-5ae6c050b842 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:44.494122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5069-5b94-4b28-aaeb-5ae6c050b842 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:44.494392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5069-5b94-4b28-aaeb-5ae6c050b842 None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:44.495085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c5069-5b94-4b28-aaeb-5ae6c050b842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:44.495387 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c5069-5b94-4b28-aaeb-5ae6c050b842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:44.496805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c5069-5b94-4b28-aaeb-5ae6c050b842 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:44.509010 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 476/949] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:44.515132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:44.533646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:44.643273 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab57d2-cfa0-472f-b2af-95a61d6a7dfd None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:44.688449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01264c73-83ec-4cf2-ad21-d545e27d4757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:44.689145 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264c73-83ec-4cf2-ad21-d545e27d4757 None admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:44.689462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264c73-83ec-4cf2-ad21-d545e27d4757 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:44.689692 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01264c73-83ec-4cf2-ad21-d545e27d4757 None admin] PATH_INFO: `/v3/projects/b7faa7d4815647198a759f065527af0c/users/6812489400ac43578d5941fa839f71c3/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:44.691538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01264c73-83ec-4cf2-ad21-d545e27d4757 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7faa7d4815647198a759f065527af0c, user_id=6812489400ac43578d5941fa839f71c3, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:44.693016 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01264c73-83ec-4cf2-ad21-d545e27d4757 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:44.705798 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 474/950] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 00:26:44 2022] PUT /identity/v3/projects/b7faa7d4815647198a759f065527af0c/users/6812489400ac43578d5941fa839f71c3/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:26:47.002090 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f8276-fcb7-481e-8deb-21074e51d2bc None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:47.002615 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f8276-fcb7-481e-8deb-21074e51d2bc None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:47.002615 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f8276-fcb7-481e-8deb-21074e51d2bc None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:47.004003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 477/951] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:47.009483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c36253-2546-4cdb-a7c8-4f4035b69a7e None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:47.009949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c36253-2546-4cdb-a7c8-4f4035b69a7e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:47.010085 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c36253-2546-4cdb-a7c8-4f4035b69a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:47.032074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-59c36253-2546-4cdb-a7c8-4f4035b69a7e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:47.033264 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-59c36253-2546-4cdb-a7c8-4f4035b69a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:47.104928 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 475/952] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:47.373669 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f8276-fcb7-481e-8deb-21074e51d2bc None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:47.421591 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:47.482028 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f8276-fcb7-481e-8deb-21074e51d2bc None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:47.520106 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:47.520771 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:47.521122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:47.521397 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:47.532815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 00:26:47.538049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:47.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:47.540584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 478/953] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 00:26:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:47.545977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c36253-2546-4cdb-a7c8-4f4035b69a7e None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:47.549114 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:47.664330 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c36253-2546-4cdb-a7c8-4f4035b69a7e None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:47.699701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:47.700306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:47.700636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:47.700871 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:47.701546 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:47.701855 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:47.703197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:47.711309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 476/954] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 00:26:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:47.717471 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:47.822883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:47.826099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccbfa7-5b19-4ba0-aebe-fd48536238f4 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:47.863277 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:47.863999 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:47.864378 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:47.864701 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:47.876121 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:47.877615 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:47.893825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:47.894983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:47.896229 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:47.896229 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:47.896229 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:47.896229 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 479/955] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:47.901122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:47.980454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:48.018843 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3c11-e4b3-495e-94f4-bc66d4e683f8 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:48.057375 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:48.058173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.058517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.058846 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.061388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:48.061388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:48.061673 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:48.075975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 477/956] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:48.081692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:48.199552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f950e-4e66-4e8f-b453-617293b2c6e5 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:48.245161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:48.245813 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.246082 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.246351 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.254891 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:48.256327 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 00:26:48.268871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:48.270035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:48.270991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 480/957] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:48.276707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:48.383382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b0442-ab44-46f5-aef2-341d5f005d2c None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:48.412547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:48.422382 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:48.422996 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.423274 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.423543 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.424270 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:48.424574 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:48.426040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:48.444196 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 478/958] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 00:26:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:48.450316 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:48.466729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:48.556621 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc47ae-0459-4319-bf64-b948ba002789 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:48.592105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:48.592721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.593006 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.593269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.669271 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:48.670739 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:48.685490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:48.768993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 481/959] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 00:26:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 00:26:48.774837 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:48.876945 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a3c14-5e60-418f-ae1e-3263e1eff8c0 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:48.910037 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:48.910658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:48.910931 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:48.911204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:48.921446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:48.922872 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 00:26:48.937748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:48.938822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 00:26:48.939908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 00:26:48.939908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 00:26:48.939908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:48.939908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 479/960] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:48.944423 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.041197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b21ec-b545-43ef-b169-d6bb4c6056d9 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.055486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:49.076200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.076802 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.077117 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.077392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.078024 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:49.078326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.079675 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.091178 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 482/961] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 00:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:49.096742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.131141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:49.193695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b77a66-a48a-47ea-a0d5-7b783e95d7d1 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.225637 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.226811 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.227073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.227340 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.233644 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.235052 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 00:26:49.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:49.247042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: ERROR keystone.server.flask.application Oct 19 00:26:49.248108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 480/962] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:49.252766 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.349177 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300ef2-e282-430f-b910-9c8cd0c153ed None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.381511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30834fc-4088-428e-b9bd-c85752c745cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.382099 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30834fc-4088-428e-b9bd-c85752c745cd None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.383016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30834fc-4088-428e-b9bd-c85752c745cd None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.383318 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30834fc-4088-428e-b9bd-c85752c745cd None admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.384005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30834fc-4088-428e-b9bd-c85752c745cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:49.384316 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30834fc-4088-428e-b9bd-c85752c745cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.385750 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30834fc-4088-428e-b9bd-c85752c745cd None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.397214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 483/963] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:49.404009 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:49.496754 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:49.502652 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aa75e-eef7-437d-9a84-745281c62eb2 None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:49.536678 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd905d0-a92d-49eb-83cc-dc0e1087bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:49.537544 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd905d0-a92d-49eb-83cc-dc0e1087bd68 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:49.537822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd905d0-a92d-49eb-83cc-dc0e1087bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:49.538091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd905d0-a92d-49eb-83cc-dc0e1087bd68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:49.539249 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd905d0-a92d-49eb-83cc-dc0e1087bd68 None admin] RBAC: Adding query filter params (role.id=08d7ebb3d6044305874059d45f17c926, scope.project.id=b7faa7d4815647198a759f065527af0c, user.id=6812489400ac43578d5941fa839f71c3) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:49.539557 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd905d0-a92d-49eb-83cc-dc0e1087bd68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:49.540990 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd905d0-a92d-49eb-83cc-dc0e1087bd68 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:49.546561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 481/964] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 00:26:49 2022] GET /identity/v3/role_assignments?user.id=6812489400ac43578d5941fa839f71c3&scope.project.id=b7faa7d4815647198a759f065527af0c&role.id=08d7ebb3d6044305874059d45f17c926 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:51.669540 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63257-a8c8-40ce-82fc-a73f0bd39020 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63257-a8c8-40ce-82fc-a73f0bd39020 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.670128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63257-a8c8-40ce-82fc-a73f0bd39020 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.671414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 484/965] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:51.676537 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8135b4-b9d0-4c25-97df-fbc7b9218f8e None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:51.677003 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8135b4-b9d0-4c25-97df-fbc7b9218f8e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:51.677229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8135b4-b9d0-4c25-97df-fbc7b9218f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:51.695506 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-ba8135b4-b9d0-4c25-97df-fbc7b9218f8e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:51.696689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-ba8135b4-b9d0-4c25-97df-fbc7b9218f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:51.761610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 482/966] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:52.028616 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63257-a8c8-40ce-82fc-a73f0bd39020 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.060153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:52.130013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63257-a8c8-40ce-82fc-a73f0bd39020 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.162989 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.164051 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.164354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.164605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.165203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:52.166553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:52.175000 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:52.176193 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:52.177301 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 485/967] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:26:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:52.182858 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8135b4-b9d0-4c25-97df-fbc7b9218f8e None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.269132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:52.279122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8135b4-b9d0-4c25-97df-fbc7b9218f8e None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.312350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be200f16-87be-48c5-88c2-525cc6d8f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.312975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200f16-87be-48c5-88c2-525cc6d8f658 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200f16-87be-48c5-88c2-525cc6d8f658 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.313528 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200f16-87be-48c5-88c2-525cc6d8f658 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.314153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200f16-87be-48c5-88c2-525cc6d8f658 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:52.314457 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200f16-87be-48c5-88c2-525cc6d8f658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:52.315815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200f16-87be-48c5-88c2-525cc6d8f658 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:52.321090 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 483/968] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 00:26:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:52.326947 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:52.418073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:52.423904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12026054-690c-480f-a315-769821d5a3b2 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:52.456291 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74236044-e985-446a-a820-10c2db47f9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:52.456825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74236044-e985-446a-a820-10c2db47f9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:52.457137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74236044-e985-446a-a820-10c2db47f9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:52.457414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74236044-e985-446a-a820-10c2db47f9f9 None admin] PATH_INFO: `/v3/services` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:52.458032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74236044-e985-446a-a820-10c2db47f9f9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:52.458336 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74236044-e985-446a-a820-10c2db47f9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:52.459698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74236044-e985-446a-a820-10c2db47f9f9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:52.464120 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 486/969] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 00:26:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:54.618520 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ce204-50af-49a4-89f7-c0702d743006 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.619096 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ce204-50af-49a4-89f7-c0702d743006 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.619096 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ce204-50af-49a4-89f7-c0702d743006 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.620391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 484/970] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:54.625761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedcbc5-7e44-400f-9034-9c7b8fdf152f None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:54.626142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedcbc5-7e44-400f-9034-9c7b8fdf152f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:54.626314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedcbc5-7e44-400f-9034-9c7b8fdf152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:54.644512 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-fdedcbc5-7e44-400f-9034-9c7b8fdf152f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:54.645703 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-fdedcbc5-7e44-400f-9034-9c7b8fdf152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:54.710948 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 487/971] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:54.975046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ce204-50af-49a4-89f7-c0702d743006 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:55.074120 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ce204-50af-49a4-89f7-c0702d743006 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:55.105904 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07130b25-0b0d-43ed-b22d-ba662a1de817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:55.106502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07130b25-0b0d-43ed-b22d-ba662a1de817 None admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:55.106782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07130b25-0b0d-43ed-b22d-ba662a1de817 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:55.107057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07130b25-0b0d-43ed-b22d-ba662a1de817 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:55.107704 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07130b25-0b0d-43ed-b22d-ba662a1de817 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:55.109086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07130b25-0b0d-43ed-b22d-ba662a1de817 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:55.123708 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 485/972] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 00:26:54 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:26:57.260003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26daa12-9d43-40fd-bcdd-f9b51b5b6e08 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:57.260515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26daa12-9d43-40fd-bcdd-f9b51b5b6e08 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:57.260515 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26daa12-9d43-40fd-bcdd-f9b51b5b6e08 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:57.261846 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 488/973] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:26:57.266870 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217619-fb35-4ae2-9a34-60e3f49e49a2 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:57.267284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217619-fb35-4ae2-9a34-60e3f49e49a2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:57.267425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217619-fb35-4ae2-9a34-60e3f49e49a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:57.285834 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-fb217619-fb35-4ae2-9a34-60e3f49e49a2 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:26:57.287277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-fb217619-fb35-4ae2-9a34-60e3f49e49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:26:57.296930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:57.359678 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 486/974] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:26:57.626677 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26daa12-9d43-40fd-bcdd-f9b51b5b6e08 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:57.722269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:57.733079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26daa12-9d43-40fd-bcdd-f9b51b5b6e08 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:57.766283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:57.766893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:57.767174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:57.767447 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:57.768017 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:57.769395 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:26:57.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:26:57.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:26:57.781032 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 489/975] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:26:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:26:57.786135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb217619-fb35-4ae2-9a34-60e3f49e49a2 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:57.888586 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb217619-fb35-4ae2-9a34-60e3f49e49a2 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:57.921972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:57.922567 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:57.922847 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:57.923116 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:57.923739 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:57.924042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:57.925425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:57.930983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 487/976] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 00:26:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:57.936945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:58.034379 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944c7a2-c910-4f8a-8a40-8fda15acfc4a None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:58.066318 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73c3d-52c3-426e-adc2-3fb482cb59a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:58.066907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73c3d-52c3-426e-adc2-3fb482cb59a9 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:58.067188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73c3d-52c3-426e-adc2-3fb482cb59a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:58.067463 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73c3d-52c3-426e-adc2-3fb482cb59a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:58.068147 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73c3d-52c3-426e-adc2-3fb482cb59a9 None admin] RBAC: Adding query filter params (interface=public, service_id=01724398570d4953a1aae5ffe0dd037c, region_id=RegionOne) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:26:58.068455 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73c3d-52c3-426e-adc2-3fb482cb59a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:58.070455 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73c3d-52c3-426e-adc2-3fb482cb59a9 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:58.075283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 490/977] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 00:26:57 2022] GET /identity/v3/endpoints?service_id=01724398570d4953a1aae5ffe0dd037c&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:26:58.080826 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:26:58.084494 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:26:58.179283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43803e-f98b-4760-95d6-c79eb8a4f88a None admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:26:58.212103 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e74e-56b8-4f2a-ae1b-4f13a044837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:26:58.212696 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e74e-56b8-4f2a-ae1b-4f13a044837e None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:26:58.213009 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e74e-56b8-4f2a-ae1b-4f13a044837e None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:26:58.213288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e74e-56b8-4f2a-ae1b-4f13a044837e None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:26:58.213889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e74e-56b8-4f2a-ae1b-4f13a044837e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:26:58.215241 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e74e-56b8-4f2a-ae1b-4f13a044837e None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:26:58.221841 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 488/978] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 00:26:58 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:27:00.346645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c9f39-197a-4d0d-9a71-0d0baee5e5e1 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.347165 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c9f39-197a-4d0d-9a71-0d0baee5e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.347254 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c9f39-197a-4d0d-9a71-0d0baee5e5e1 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.348522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 491/979] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:27:00.354122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1633-ded5-4983-8e9c-a49fb0f5edf8 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.354560 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1633-ded5-4983-8e9c-a49fb0f5edf8 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.354659 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1633-ded5-4983-8e9c-a49fb0f5edf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.372947 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-b48d1633-ded5-4983-8e9c-a49fb0f5edf8 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:27:00.374122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b48d1633-ded5-4983-8e9c-a49fb0f5edf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:27:00.432915 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:00.438605 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 489/980] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:27:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 00:27:00.719331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c9f39-197a-4d0d-9a71-0d0baee5e5e1 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:00.739470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:00.831560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c9f39-197a-4d0d-9a71-0d0baee5e5e1 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:00.868992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:00.869974 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:00.870443 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:00.870899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:00.871847 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:00.873972 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 00:27:00.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 00:27:00.884436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application with Lock( Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self._enter() Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application return self.creator() Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application created_value = creator( Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: ERROR keystone.server.flask.application Oct 19 00:27:00.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 492/981] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 00:27:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 00:27:00.890525 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1633-ded5-4983-8e9c-a49fb0f5edf8 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.001404 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1633-ded5-4983-8e9c-a49fb0f5edf8 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.036697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb32fa-e991-4908-a322-8160dafd1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.037583 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb32fa-e991-4908-a322-8160dafd1616 None admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb32fa-e991-4908-a322-8160dafd1616 None admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.038797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb32fa-e991-4908-a322-8160dafd1616 None admin] PATH_INFO: `/v3/services` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.039682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb32fa-e991-4908-a322-8160dafd1616 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:27:01.040025 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb32fa-e991-4908-a322-8160dafd1616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.041523 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb32fa-e991-4908-a322-8160dafd1616 None admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.047211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 490/982] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 00:27:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:27:01.053071 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:27:01.137007 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:01.156871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625a974-5bdb-428d-8240-ebd3f5b1ea13 None admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:27:01.192602 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb1be6-c15a-4395-948c-71b7d5a85824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:27:01.193252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb1be6-c15a-4395-948c-71b7d5a85824 None admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:27:01.193540 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb1be6-c15a-4395-948c-71b7d5a85824 None admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:27:01.193822 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb1be6-c15a-4395-948c-71b7d5a85824 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:27:01.194533 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb1be6-c15a-4395-948c-71b7d5a85824 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:27:01.195900 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb1be6-c15a-4395-948c-71b7d5a85824 None admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:27:01.216430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 493/983] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:27:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:27:11.044147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=69 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:27:11.211951 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:05.113345 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06a3a-ccd0-4777-8674-fe9c702c9ee4 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.115181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06a3a-ccd0-4777-8674-fe9c702c9ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.115917 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06a3a-ccd0-4777-8674-fe9c702c9ee4 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.118710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 491/984] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:05.123931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18301dd-39e5-4479-90d7-5d80b850f879 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.124346 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18301dd-39e5-4479-90d7-5d80b850f879 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.124492 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18301dd-39e5-4479-90d7-5d80b850f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.252100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-a18301dd-39e5-4479-90d7-5d80b850f879 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:05.253374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a18301dd-39e5-4479-90d7-5d80b850f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:05.366219 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 494/985] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:05.663117 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fa5b-3545-48a3-beb8-44d41ed17192 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.663396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fa5b-3545-48a3-beb8-44d41ed17192 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.663869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fa5b-3545-48a3-beb8-44d41ed17192 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.665257 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 492/986] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 19 00:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:05.671234 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ff96-140c-4831-b92a-4a1e77fa75be None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:05.671643 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ff96-140c-4831-b92a-4a1e77fa75be None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:05.672025 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ff96-140c-4831-b92a-4a1e77fa75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:05.759177 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-7766ff96-140c-4831-b92a-4a1e77fa75be None None] MFA Rules not processed for user `eb62183c29e74f75a580306cf6cfae56`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:05.760541 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-7766ff96-140c-4831-b92a-4a1e77fa75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:05.783135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:05.845282 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 495/987] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 19 00:28:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:05.855350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122fa5b-3545-48a3-beb8-44d41ed17192 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:05.857168 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-1122fa5b-3545-48a3-beb8-44d41ed17192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:05.973577 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122fa5b-3545-48a3-beb8-44d41ed17192 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:06.055496 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45cc19-88a0-41a4-9e6e-0ad0855b5e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:06.056307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cc19-88a0-41a4-9e6e-0ad0855b5e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:06.056591 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cc19-88a0-41a4-9e6e-0ad0855b5e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:06.056943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cc19-88a0-41a4-9e6e-0ad0855b5e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:06.058515 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-1a45cc19-88a0-41a4-9e6e-0ad0855b5e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:06.120856 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:06.185525 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45cc19-88a0-41a4-9e6e-0ad0855b5e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:06.187689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45cc19-88a0-41a4-9e6e-0ad0855b5e8f service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:06.210868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 493/988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:08.706689 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33eb9-35ef-4300-833e-b639097c4e00 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.707194 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33eb9-35ef-4300-833e-b639097c4e00 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.707194 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33eb9-35ef-4300-833e-b639097c4e00 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.709388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 496/989] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:08.714608 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145d9f-8ec6-4739-b8fc-080a31b10ccc None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:08.715023 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145d9f-8ec6-4739-b8fc-080a31b10ccc None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:08.715163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145d9f-8ec6-4739-b8fc-080a31b10ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:08.787952 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-5e145d9f-8ec6-4739-b8fc-080a31b10ccc None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:08.789187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-5e145d9f-8ec6-4739-b8fc-080a31b10ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:08.885399 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 494/990] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:09.162441 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33eb9-35ef-4300-833e-b639097c4e00 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:09.164143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-c3f33eb9-35ef-4300-833e-b639097c4e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:09.273732 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33eb9-35ef-4300-833e-b639097c4e00 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:09.344541 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:09.346860 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf572e-b7a6-4d69-a4c1-e30c0c893381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:09.347666 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf572e-b7a6-4d69-a4c1-e30c0c893381 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:09.348135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf572e-b7a6-4d69-a4c1-e30c0c893381 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:09.348640 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf572e-b7a6-4d69-a4c1-e30c0c893381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:09.350564 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-0faf572e-b7a6-4d69-a4c1-e30c0c893381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:09.458139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf572e-b7a6-4d69-a4c1-e30c0c893381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:09.459479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf572e-b7a6-4d69-a4c1-e30c0c893381 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:09.477347 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 497/991] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:11.909251 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5dda-cc48-462b-8c63-58554118a458 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.909815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5dda-cc48-462b-8c63-58554118a458 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.909815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5dda-cc48-462b-8c63-58554118a458 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.911378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 495/992] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:11.916870 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8253f-27f9-4ef6-8c35-a583006a195b None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:11.917307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8253f-27f9-4ef6-8c35-a583006a195b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:11.917402 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8253f-27f9-4ef6-8c35-a583006a195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:11.983648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-8ec8253f-27f9-4ef6-8c35-a583006a195b None None] MFA Rules not processed for user `9e45f34588cb4e95a03f2a9be447c9af`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:11.984863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-8ec8253f-27f9-4ef6-8c35-a583006a195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:12.036272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:12.080030 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 498/993] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:12.364806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb5dda-cc48-462b-8c63-58554118a458 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:12.366367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-37bb5dda-cc48-462b-8c63-58554118a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:12.376410 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:12.471691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb5dda-cc48-462b-8c63-58554118a458 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:12.545324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ab0ed-34be-4573-be4a-710a1d3d9d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:12.545925 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab0ed-34be-4573-be4a-710a1d3d9d8c service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:12.546206 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab0ed-34be-4573-be4a-710a1d3d9d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:12.546481 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab0ed-34be-4573-be4a-710a1d3d9d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:12.548070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-100ab0ed-34be-4573-be4a-710a1d3d9d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:12.609632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:12.657700 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ab0ed-34be-4573-be4a-710a1d3d9d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:12.659128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ab0ed-34be-4573-be4a-710a1d3d9d8c service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:12.677450 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 496/994] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:28:15.359904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ca52-5437-4133-9970-d17db07c1eeb None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.360432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ca52-5437-4133-9970-d17db07c1eeb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.360432 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74ca52-5437-4133-9970-d17db07c1eeb None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.361830 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 499/995] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:15.367890 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718cc1-7881-41eb-8a21-f4d9a9afaf3c None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.368294 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718cc1-7881-41eb-8a21-f4d9a9afaf3c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.368587 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718cc1-7881-41eb-8a21-f4d9a9afaf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:15.434633 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-b9718cc1-7881-41eb-8a21-f4d9a9afaf3c None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:15.435831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b9718cc1-7881-41eb-8a21-f4d9a9afaf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:15.530552 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 497/996] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:28:15.822936 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74ca52-5437-4133-9970-d17db07c1eeb None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:15.824471 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-cc74ca52-5437-4133-9970-d17db07c1eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:15.925070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74ca52-5437-4133-9970-d17db07c1eeb None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:15.998012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c7daf-0c06-47dd-b9c0-0486903fed8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:15.998593 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7daf-0c06-47dd-b9c0-0486903fed8e service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:15.998868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7daf-0c06-47dd-b9c0-0486903fed8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:15.999137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7daf-0c06-47dd-b9c0-0486903fed8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:16.000705 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-5f7c7daf-0c06-47dd-b9c0-0486903fed8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:16.007362 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:16.108746 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c7daf-0c06-47dd-b9c0-0486903fed8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:16.110139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c7daf-0c06-47dd-b9c0-0486903fed8e service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:16.128504 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 500/997] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:18.903829 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae877f50-d236-46ab-84e3-11ccd61043fd None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:18.904364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae877f50-d236-46ab-84e3-11ccd61043fd None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:18.904364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae877f50-d236-46ab-84e3-11ccd61043fd None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:18.905786 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 498/998] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:18.911630 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3079c5-f07e-40ed-b88a-b6176b4bfceb None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:18.912303 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3079c5-f07e-40ed-b88a-b6176b4bfceb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:18.912442 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3079c5-f07e-40ed-b88a-b6176b4bfceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:18.985559 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-bd3079c5-f07e-40ed-b88a-b6176b4bfceb None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:18.986826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-bd3079c5-f07e-40ed-b88a-b6176b4bfceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:19.050963 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:19.094340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 501/999] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:19.390159 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28dcd8-e809-4a4c-a73e-59b7354a8963 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.390558 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28dcd8-e809-4a4c-a73e-59b7354a8963 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.390904 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28dcd8-e809-4a4c-a73e-59b7354a8963 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.392512 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 499/1000] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 19 00:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:19.398827 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ee40-095f-44bf-b853-504d6df04aac None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.399115 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ee40-095f-44bf-b853-504d6df04aac None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.399391 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ee40-095f-44bf-b853-504d6df04aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.476635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-44f1ee40-095f-44bf-b853-504d6df04aac None None] MFA Rules not processed for user `eb62183c29e74f75a580306cf6cfae56`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:19.477866 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-44f1ee40-095f-44bf-b853-504d6df04aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:19.554081 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 502/1001] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 19 00:28:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:19.563102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28dcd8-e809-4a4c-a73e-59b7354a8963 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:19.564681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-cc28dcd8-e809-4a4c-a73e-59b7354a8963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:19.585308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:19.671328 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28dcd8-e809-4a4c-a73e-59b7354a8963 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:19.746167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1fe00-794b-4fc1-86cd-b2f8e1394782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:19.746768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1fe00-794b-4fc1-86cd-b2f8e1394782 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:19.747043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1fe00-794b-4fc1-86cd-b2f8e1394782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:19.747343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1fe00-794b-4fc1-86cd-b2f8e1394782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:19.748967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-35b1fe00-794b-4fc1-86cd-b2f8e1394782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:19.820059 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:19.858199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1fe00-794b-4fc1-86cd-b2f8e1394782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:19.859631 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1fe00-794b-4fc1-86cd-b2f8e1394782 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:19.877409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 500/1002] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:22.355493 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d3de0-abef-4502-be68-d89c81aee572 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:22.355994 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d3de0-abef-4502-be68-d89c81aee572 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:22.355994 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d3de0-abef-4502-be68-d89c81aee572 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:22.357326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 503/1003] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:22.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc64d-bd92-4f91-87a6-556f2584ac29 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:22.363031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc64d-bd92-4f91-87a6-556f2584ac29 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:22.363226 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc64d-bd92-4f91-87a6-556f2584ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:22.428986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-9d2cc64d-bd92-4f91-87a6-556f2584ac29 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:22.430191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9d2cc64d-bd92-4f91-87a6-556f2584ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:22.527079 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 501/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:22.814008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d3de0-abef-4502-be68-d89c81aee572 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:22.815556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-463d3de0-abef-4502-be68-d89c81aee572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:22.884232 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:22.928221 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d3de0-abef-4502-be68-d89c81aee572 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:23.005200 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c1d61-f1eb-4fc6-ab24-1fb39b612a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:23.005815 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c1d61-f1eb-4fc6-ab24-1fb39b612a7d service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:23.006098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c1d61-f1eb-4fc6-ab24-1fb39b612a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:23.006377 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c1d61-f1eb-4fc6-ab24-1fb39b612a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:23.007982 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-252c1d61-f1eb-4fc6-ab24-1fb39b612a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:23.116227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:23.118612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c1d61-f1eb-4fc6-ab24-1fb39b612a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:23.120403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c1d61-f1eb-4fc6-ab24-1fb39b612a7d service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:23.139435 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 504/1005] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:25.389611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0dba8-d616-47a5-96d5-ed4713a1dc3d None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:25.390147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0dba8-d616-47a5-96d5-ed4713a1dc3d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:25.390147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0dba8-d616-47a5-96d5-ed4713a1dc3d None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:25.391516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 502/1006] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:25.397182 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ae79a-f161-4cbe-a6ce-0917a5b3c5be None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:25.397690 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ae79a-f161-4cbe-a6ce-0917a5b3c5be None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:25.397785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ae79a-f161-4cbe-a6ce-0917a5b3c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:25.468430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ca1ae79a-f161-4cbe-a6ce-0917a5b3c5be None None] MFA Rules not processed for user `9e45f34588cb4e95a03f2a9be447c9af`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:25.469975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ca1ae79a-f161-4cbe-a6ce-0917a5b3c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:25.572077 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 505/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:25.859049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0dba8-d616-47a5-96d5-ed4713a1dc3d None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:25.860662 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-5cb0dba8-d616-47a5-96d5-ed4713a1dc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:25.891669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:25.968090 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0dba8-d616-47a5-96d5-ed4713a1dc3d None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:26.047974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf21bb8-ea0c-4331-8278-af3383b6dc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:26.048683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf21bb8-ea0c-4331-8278-af3383b6dc8a service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:26.048998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf21bb8-ea0c-4331-8278-af3383b6dc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:26.049271 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf21bb8-ea0c-4331-8278-af3383b6dc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:26.051468 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8cf21bb8-ea0c-4331-8278-af3383b6dc8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:26.135077 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:26.171427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf21bb8-ea0c-4331-8278-af3383b6dc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:26.172879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf21bb8-ea0c-4331-8278-af3383b6dc8a service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:26.192044 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 503/1008] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:28.613595 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcb33e-019e-4494-b331-4d9dd7099fe9 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:28.614211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcb33e-019e-4494-b331-4d9dd7099fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:28.614211 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcb33e-019e-4494-b331-4d9dd7099fe9 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:28.615470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 506/1009] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:28.620716 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6b466-c7d7-4037-8cf1-0a45653d949b None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:28.621168 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6b466-c7d7-4037-8cf1-0a45653d949b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:28.621387 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6b466-c7d7-4037-8cf1-0a45653d949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:28.687224 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-54f6b466-c7d7-4037-8cf1-0a45653d949b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:28.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-54f6b466-c7d7-4037-8cf1-0a45653d949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:28.784702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 504/1010] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:29.061924 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcb33e-019e-4494-b331-4d9dd7099fe9 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:29.063462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-f0bcb33e-019e-4494-b331-4d9dd7099fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:29.132259 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:29.166989 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcb33e-019e-4494-b331-4d9dd7099fe9 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:29.240120 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ceeaf-1b77-4021-b72e-23f972933c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:29.240711 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceeaf-1b77-4021-b72e-23f972933c35 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:29.241020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceeaf-1b77-4021-b72e-23f972933c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:29.241314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceeaf-1b77-4021-b72e-23f972933c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:29.242903 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-f52ceeaf-1b77-4021-b72e-23f972933c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:29.351552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ceeaf-1b77-4021-b72e-23f972933c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:29.352904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ceeaf-1b77-4021-b72e-23f972933c35 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:29.362476 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:29.371505 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 507/1011] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:31.612184 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b240-1719-4e2d-82b0-c1c41516a0fa None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:31.612737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b240-1719-4e2d-82b0-c1c41516a0fa None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:31.612737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b240-1719-4e2d-82b0-c1c41516a0fa None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:31.615204 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 505/1012] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:31.620334 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155eb7-f560-4eec-a0fb-07ecdf6450cb None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:31.620733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155eb7-f560-4eec-a0fb-07ecdf6450cb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:31.620967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155eb7-f560-4eec-a0fb-07ecdf6450cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:31.690399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-49155eb7-f560-4eec-a0fb-07ecdf6450cb None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:31.692065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-49155eb7-f560-4eec-a0fb-07ecdf6450cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:31.789503 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 508/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:32.083338 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b240-1719-4e2d-82b0-c1c41516a0fa None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:32.084973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c411b240-1719-4e2d-82b0-c1c41516a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:32.127030 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:32.193498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b240-1719-4e2d-82b0-c1c41516a0fa None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:32.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6980-8db8-4a97-8203-7c72ab8c2139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:32.266403 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6980-8db8-4a97-8203-7c72ab8c2139 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:32.266679 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6980-8db8-4a97-8203-7c72ab8c2139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:32.266949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6980-8db8-4a97-8203-7c72ab8c2139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:32.268528 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2caf6980-8db8-4a97-8203-7c72ab8c2139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:32.350780 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:32.376454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf6980-8db8-4a97-8203-7c72ab8c2139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:32.377927 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf6980-8db8-4a97-8203-7c72ab8c2139 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:32.395654 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 506/1014] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:34.850628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26a22-cc56-431a-a917-d19a1f1a40ed None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.851185 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26a22-cc56-431a-a917-d19a1f1a40ed None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.851185 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26a22-cc56-431a-a917-d19a1f1a40ed None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.852495 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 509/1015] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:34.857683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3abe-b319-44f3-8d8d-17f3a57e62a5 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:34.858068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3abe-b319-44f3-8d8d-17f3a57e62a5 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:34.858228 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3abe-b319-44f3-8d8d-17f3a57e62a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:34.922517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-a6fd3abe-b319-44f3-8d8d-17f3a57e62a5 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:34.923695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-a6fd3abe-b319-44f3-8d8d-17f3a57e62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:35.018264 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 507/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:35.304236 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26a22-cc56-431a-a917-d19a1f1a40ed None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:35.305884 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a8f26a22-cc56-431a-a917-d19a1f1a40ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:35.381439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:35.410802 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26a22-cc56-431a-a917-d19a1f1a40ed None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:35.482808 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07237f-8197-48a5-b2d3-e4eca744fe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:35.483338 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07237f-8197-48a5-b2d3-e4eca744fe06 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:35.483614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07237f-8197-48a5-b2d3-e4eca744fe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:35.483882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07237f-8197-48a5-b2d3-e4eca744fe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:35.485479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ba07237f-8197-48a5-b2d3-e4eca744fe06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:35.592075 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07237f-8197-48a5-b2d3-e4eca744fe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:35.593558 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07237f-8197-48a5-b2d3-e4eca744fe06 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:35.614225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 510/1017] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:39.655116 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9612e-0c9c-42b7-a645-372285b6a0c9 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.655610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9612e-0c9c-42b7-a645-372285b6a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.655610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9612e-0c9c-42b7-a645-372285b6a0c9 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.657126 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 508/1018] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:39.662676 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2877-8f23-4937-b934-67ebc9d7200e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:39.663083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2877-8f23-4937-b934-67ebc9d7200e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:39.663220 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2877-8f23-4937-b934-67ebc9d7200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:39.669491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:39.731245 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-08dd2877-8f23-4937-b934-67ebc9d7200e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:39.732445 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-08dd2877-8f23-4937-b934-67ebc9d7200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:39.827667 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 511/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:40.111657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9612e-0c9c-42b7-a645-372285b6a0c9 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:40.113756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-bca9612e-0c9c-42b7-a645-372285b6a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:40.163452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.221056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9612e-0c9c-42b7-a645-372285b6a0c9 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:40.295453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5091a5-1040-4b97-8bb6-057eff741d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:40.296060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5091a5-1040-4b97-8bb6-057eff741d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:40.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5091a5-1040-4b97-8bb6-057eff741d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:40.296625 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5091a5-1040-4b97-8bb6-057eff741d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:40.298254 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8b5091a5-1040-4b97-8bb6-057eff741d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:40.392473 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:40.411097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5091a5-1040-4b97-8bb6-057eff741d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:40.412806 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5091a5-1040-4b97-8bb6-057eff741d78 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:40.431899 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 509/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:43.247769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6f52-49cf-4364-945b-7717eac60745 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:43.248330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6f52-49cf-4364-945b-7717eac60745 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:43.248330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6f52-49cf-4364-945b-7717eac60745 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:43.249701 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 512/1021] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:43.255479 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fdbb6-8c01-4cdf-8b56-3578e442b69d None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:43.255887 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fdbb6-8c01-4cdf-8b56-3578e442b69d None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:43.256140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fdbb6-8c01-4cdf-8b56-3578e442b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:43.323637 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-fd0fdbb6-8c01-4cdf-8b56-3578e442b69d None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:43.324862 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-fd0fdbb6-8c01-4cdf-8b56-3578e442b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:43.425005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 510/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:28:43.713019 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b6f52-49cf-4364-945b-7717eac60745 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:43.714545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-d64b6f52-49cf-4364-945b-7717eac60745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:43.807565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:43.824909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b6f52-49cf-4364-945b-7717eac60745 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:43.897367 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942bb5-ac53-4a5d-a3c6-b6acd2a1c01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:43.897875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942bb5-ac53-4a5d-a3c6-b6acd2a1c01f service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:43.898153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942bb5-ac53-4a5d-a3c6-b6acd2a1c01f service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:43.898419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942bb5-ac53-4a5d-a3c6-b6acd2a1c01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:43.899990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a6942bb5-ac53-4a5d-a3c6-b6acd2a1c01f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:44.017304 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942bb5-ac53-4a5d-a3c6-b6acd2a1c01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:44.019298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942bb5-ac53-4a5d-a3c6-b6acd2a1c01f service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:44.038929 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 513/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:48.152777 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc8ef-e567-4fe1-86ee-3fe32721df92 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:48.153259 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc8ef-e567-4fe1-86ee-3fe32721df92 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:48.153419 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc8ef-e567-4fe1-86ee-3fe32721df92 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:48.154727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 511/1024] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:48.160380 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84195e-d20d-4558-9fc2-a157382c4d7e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:48.160804 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84195e-d20d-4558-9fc2-a157382c4d7e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:48.160989 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84195e-d20d-4558-9fc2-a157382c4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:48.177075 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:48.231435 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-2f84195e-d20d-4558-9fc2-a157382c4d7e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:48.232655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-2f84195e-d20d-4558-9fc2-a157382c4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:48.329709 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 514/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:48.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc8ef-e567-4fe1-86ee-3fe32721df92 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:28:48.619626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-681cc8ef-e567-4fe1-86ee-3fe32721df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:48.681859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:48.728201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc8ef-e567-4fe1-86ee-3fe32721df92 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:28:48.801859 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67ad31-1ec7-44c7-ba95-22a7bb5756e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:28:48.802462 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ad31-1ec7-44c7-ba95-22a7bb5756e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:48.802741 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ad31-1ec7-44c7-ba95-22a7bb5756e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:48.803011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ad31-1ec7-44c7-ba95-22a7bb5756e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:48.804611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-0c67ad31-1ec7-44c7-ba95-22a7bb5756e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:48.907938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:48.913020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67ad31-1ec7-44c7-ba95-22a7bb5756e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:28:48.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67ad31-1ec7-44c7-ba95-22a7bb5756e6 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:28:48.933073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 512/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:28:53.986498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21152304-57de-4340-9755-539ac6e346ac None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.987648 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21152304-57de-4340-9755-539ac6e346ac None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.988986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21152304-57de-4340-9755-539ac6e346ac None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:53.990996 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 515/1027] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:28:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:53.997618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6308-e619-4597-96ba-3f7cd7cace9a None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:53.997618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6308-e619-4597-96ba-3f7cd7cace9a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:53.997618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6308-e619-4597-96ba-3f7cd7cace9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:54.136995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-142d6308-e619-4597-96ba-3f7cd7cace9a None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:54.138358 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-142d6308-e619-4597-96ba-3f7cd7cace9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:54.273961 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 513/1028] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:28:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:28:58.328180 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=59 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.345072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a08e-a7f4-4014-85b8-9a7e3029fa73 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.345498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a08e-a7f4-4014-85b8-9a7e3029fa73 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.345887 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a08e-a7f4-4014-85b8-9a7e3029fa73 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.348529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 516/1029] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:28:58.353683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ed37-2416-4e01-aa2d-2d21dca0de19 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:28:58.354128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ed37-2416-4e01-aa2d-2d21dca0de19 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:28:58.354435 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ed37-2416-4e01-aa2d-2d21dca0de19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:28:58.412237 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:28:58.443682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-1675ed37-2416-4e01-aa2d-2d21dca0de19 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:28:58.445069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-1675ed37-2416-4e01-aa2d-2d21dca0de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:28:58.563108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 514/1030] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:28:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:00.014335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9730e-180c-4572-a9d2-fbcbd328b0b1 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.014871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9730e-180c-4572-a9d2-fbcbd328b0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.014871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9730e-180c-4572-a9d2-fbcbd328b0b1 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.016209 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 517/1031] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:00.021589 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe7eb8-7403-4cab-8c2b-cb3132275a43 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:00.022049 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe7eb8-7403-4cab-8c2b-cb3132275a43 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:00.022147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe7eb8-7403-4cab-8c2b-cb3132275a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:00.100803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-eafe7eb8-7403-4cab-8c2b-cb3132275a43 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:00.102030 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-eafe7eb8-7403-4cab-8c2b-cb3132275a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:00.144853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:00.212352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 515/1032] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:03.806097 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30fc9-b234-482e-9919-f70ab5c35097 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.807024 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30fc9-b234-482e-9919-f70ab5c35097 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.807521 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30fc9-b234-482e-9919-f70ab5c35097 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.809675 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 518/1033] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:03.815570 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185aed9-a842-4f73-8953-465490b8398e None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:03.816434 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185aed9-a842-4f73-8953-465490b8398e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:03.816981 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185aed9-a842-4f73-8953-465490b8398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:03.894040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-a185aed9-a842-4f73-8953-465490b8398e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:03.895398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-a185aed9-a842-4f73-8953-465490b8398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:04.008868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 516/1034] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:04.323326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9735-b301-4350-bbde-2cab42a70f7c None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:04.323635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9735-b301-4350-bbde-2cab42a70f7c None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:04.324356 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9735-b301-4350-bbde-2cab42a70f7c None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.326225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 519/1035] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 00:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:04.335265 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36182c9c-a689-442d-b322-f8c7c6c21e9e None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:04.335826 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36182c9c-a689-442d-b322-f8c7c6c21e9e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:04.336316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36182c9c-a689-442d-b322-f8c7c6c21e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.354726 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:04.418289 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-36182c9c-a689-442d-b322-f8c7c6c21e9e None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:04.419850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-36182c9c-a689-442d-b322-f8c7c6c21e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:04.557095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 517/1036] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 00:29:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:04.565536 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9735-b301-4350-bbde-2cab42a70f7c None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:04.567039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-80af9735-b301-4350-bbde-2cab42a70f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:04.725783 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9735-b301-4350-bbde-2cab42a70f7c None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:04.804285 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:04.846689 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af3430-eabe-468e-9852-7c7cc8ac773f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:04.847330 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af3430-eabe-468e-9852-7c7cc8ac773f service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:04.847611 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af3430-eabe-468e-9852-7c7cc8ac773f service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:04.847885 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af3430-eabe-468e-9852-7c7cc8ac773f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:04.849533 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-38af3430-eabe-468e-9852-7c7cc8ac773f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:04.957691 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af3430-eabe-468e-9852-7c7cc8ac773f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:04.960414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af3430-eabe-468e-9852-7c7cc8ac773f service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:04.982308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 520/1037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:07.356267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c17a-589c-431f-ac76-0e8dc394fc31 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.356788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c17a-589c-431f-ac76-0e8dc394fc31 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.356788 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c17a-589c-431f-ac76-0e8dc394fc31 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.362542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 518/1038] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:07.373031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5c6f8-0a51-43b3-89c1-1beb62d4a203 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:07.373031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5c6f8-0a51-43b3-89c1-1beb62d4a203 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:07.373031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5c6f8-0a51-43b3-89c1-1beb62d4a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:07.468685 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-82f5c6f8-0a51-43b3-89c1-1beb62d4a203 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:07.469909 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-82f5c6f8-0a51-43b3-89c1-1beb62d4a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:07.513176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:07.575644 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 521/1039] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:07.874772 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770c17a-589c-431f-ac76-0e8dc394fc31 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:07.876288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-1770c17a-589c-431f-ac76-0e8dc394fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:07.952983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:08.060935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770c17a-589c-431f-ac76-0e8dc394fc31 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:08.191846 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deec100-ca90-4ef5-8413-1c1a48c19abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:08.192449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec100-ca90-4ef5-8413-1c1a48c19abc service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:08.192725 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec100-ca90-4ef5-8413-1c1a48c19abc service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:08.193043 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec100-ca90-4ef5-8413-1c1a48c19abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:08.194634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-3deec100-ca90-4ef5-8413-1c1a48c19abc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:08.217208 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:08.286329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deec100-ca90-4ef5-8413-1c1a48c19abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:08.288216 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deec100-ca90-4ef5-8413-1c1a48c19abc service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:08.307160 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 519/1040] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:10.821392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0c67-a20c-4538-ae8e-2d0f4c2fdc96 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.821955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0c67-a20c-4538-ae8e-2d0f4c2fdc96 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.821955 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0c67-a20c-4538-ae8e-2d0f4c2fdc96 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.823430 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 522/1041] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:10.828484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e3442-6e35-4742-91a2-7918c22e06e4 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:10.828896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e3442-6e35-4742-91a2-7918c22e06e4 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:10.829067 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e3442-6e35-4742-91a2-7918c22e06e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:10.898021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-d16e3442-6e35-4742-91a2-7918c22e06e4 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:10.899233 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d16e3442-6e35-4742-91a2-7918c22e06e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:11.010161 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.020964 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 520/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:11.316165 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70831f-5d9b-48eb-abd4-96ab22cf628e None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.316450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70831f-5d9b-48eb-abd4-96ab22cf628e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.316726 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70831f-5d9b-48eb-abd4-96ab22cf628e None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.318264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 523/1043] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 00:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:11.323427 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4cf85-c70b-403b-87e2-2d07c7f349c9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.323785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4cf85-c70b-403b-87e2-2d07c7f349c9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.324132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4cf85-c70b-403b-87e2-2d07c7f349c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.405277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-08d4cf85-c70b-403b-87e2-2d07c7f349c9 None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:11.406585 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-08d4cf85-c70b-403b-87e2-2d07c7f349c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:11.530337 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 521/1044] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 00:29:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:11.539518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70831f-5d9b-48eb-abd4-96ab22cf628e None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:11.541321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-bd70831f-5d9b-48eb-abd4-96ab22cf628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:11.700468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70831f-5d9b-48eb-abd4-96ab22cf628e None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:11.723888 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:11.826546 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc8509-6f16-4cf9-8796-8616082f8167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:11.827252 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc8509-6f16-4cf9-8796-8616082f8167 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:11.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc8509-6f16-4cf9-8796-8616082f8167 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:11.827706 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc8509-6f16-4cf9-8796-8616082f8167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:11.829310 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a0cc8509-6f16-4cf9-8796-8616082f8167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:11.925373 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc8509-6f16-4cf9-8796-8616082f8167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:11.927019 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc8509-6f16-4cf9-8796-8616082f8167 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:11.953021 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 524/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:12.057923 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2e33-cccc-4f2a-a405-15b2b3556da7 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.058416 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2e33-cccc-4f2a-a405-15b2b3556da7 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.058500 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af2e33-cccc-4f2a-a405-15b2b3556da7 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.060005 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 522/1046] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:12.066466 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb083-2ec4-41d0-b0ad-425030e796e4 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.066938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb083-2ec4-41d0-b0ad-425030e796e4 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.067332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb083-2ec4-41d0-b0ad-425030e796e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.108748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.153975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-27bcb083-2ec4-41d0-b0ad-425030e796e4 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:12.155235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-27bcb083-2ec4-41d0-b0ad-425030e796e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:12.266829 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 525/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:12.601958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da717c-f210-43de-844a-2f908225cfc3 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.601958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da717c-f210-43de-844a-2f908225cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.601958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da717c-f210-43de-844a-2f908225cfc3 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.604810 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 523/1048] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 19 00:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:12.608912 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d87693-cee9-4030-9408-4d0ce063a3e0 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:12.608912 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d87693-cee9-4030-9408-4d0ce063a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:12.609290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d87693-cee9-4030-9408-4d0ce063a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:12.708076 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-72d87693-cee9-4030-9408-4d0ce063a3e0 None None] MFA Rules not processed for user `0448c6383cd142b68d1962842eeb1623`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:12.709684 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-72d87693-cee9-4030-9408-4d0ce063a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:12.761081 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.795741 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 526/1049] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 19 00:29:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:12.803717 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da717c-f210-43de-844a-2f908225cfc3 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:12.805237 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d0da717c-f210-43de-844a-2f908225cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:12.860084 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:12.925849 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da717c-f210-43de-844a-2f908225cfc3 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:13.036048 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f166f-2923-43e5-b5f2-4a06fa8dc855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0448c6383cd142b68d1962842eeb1623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:13.037291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f166f-2923-43e5-b5f2-4a06fa8dc855 service cinder] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:13.037709 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f166f-2923-43e5-b5f2-4a06fa8dc855 service cinder] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:13.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f166f-2923-43e5-b5f2-4a06fa8dc855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:13.040144 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-3a6f166f-2923-43e5-b5f2-4a06fa8dc855 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:13.184193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:13.209061 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f166f-2923-43e5-b5f2-4a06fa8dc855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:13.210781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f166f-2923-43e5-b5f2-4a06fa8dc855 service cinder] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:13.238293 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 524/1050] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:14.224488 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5d4a-6f31-4c2c-84ba-8b0a9797a06d None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.225029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5d4a-6f31-4c2c-84ba-8b0a9797a06d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.225029 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5d4a-6f31-4c2c-84ba-8b0a9797a06d None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.226522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 527/1051] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:29:14.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716ddab-4f38-4146-b8bf-49d2c90db5a8 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.232320 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716ddab-4f38-4146-b8bf-49d2c90db5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.232466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716ddab-4f38-4146-b8bf-49d2c90db5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.299487 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-3716ddab-4f38-4146-b8bf-49d2c90db5a8 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:14.300882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-3716ddab-4f38-4146-b8bf-49d2c90db5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:14.397706 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 525/1052] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:29:14.687761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5d4a-6f31-4c2c-84ba-8b0a9797a06d None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:14.689731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-aacc5d4a-6f31-4c2c-84ba-8b0a9797a06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:14.852295 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5d4a-6f31-4c2c-84ba-8b0a9797a06d None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:14.906774 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:14.971967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fae3da-2696-4327-a919-b1c3d30e4e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:14.972583 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae3da-2696-4327-a919-b1c3d30e4e18 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:14.972911 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae3da-2696-4327-a919-b1c3d30e4e18 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:14.973195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae3da-2696-4327-a919-b1c3d30e4e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:14.974814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-c4fae3da-2696-4327-a919-b1c3d30e4e18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:15.068645 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fae3da-2696-4327-a919-b1c3d30e4e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:15.070364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fae3da-2696-4327-a919-b1c3d30e4e18 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:15.090020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 528/1053] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:17.356003 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6ac4-4e34-455d-a10d-89efb097e193 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.356539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6ac4-4e34-455d-a10d-89efb097e193 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.356539 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6ac4-4e34-455d-a10d-89efb097e193 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.357910 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 526/1054] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:17.363966 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29391-cf6a-4ad5-a92e-cabba26cd72e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:17.364420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29391-cf6a-4ad5-a92e-cabba26cd72e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:17.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29391-cf6a-4ad5-a92e-cabba26cd72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:17.432845 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-76c29391-cf6a-4ad5-a92e-cabba26cd72e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:17.434054 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-76c29391-cf6a-4ad5-a92e-cabba26cd72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:17.441289 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:17.544889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 529/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:17.844112 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6ac4-4e34-455d-a10d-89efb097e193 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:17.846400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-800f6ac4-4e34-455d-a10d-89efb097e193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:17.910075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.003688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6ac4-4e34-455d-a10d-89efb097e193 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:18.121142 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d5f90-374e-485e-acea-149d15ae92d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:18.121660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5f90-374e-485e-acea-149d15ae92d6 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:18.121938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5f90-374e-485e-acea-149d15ae92d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:18.122211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5f90-374e-485e-acea-149d15ae92d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:18.123789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-7f2d5f90-374e-485e-acea-149d15ae92d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:18.145376 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:18.220791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d5f90-374e-485e-acea-149d15ae92d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:18.222554 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d5f90-374e-485e-acea-149d15ae92d6 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:18.243205 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 527/1056] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:20.465389 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c4f4-560e-409d-b997-291945b4deec None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.465862 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c4f4-560e-409d-b997-291945b4deec None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.466055 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c4f4-560e-409d-b997-291945b4deec None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.467281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 530/1057] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:20.473425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375070f1-3db5-4dfe-9dfa-fdbc9acde302 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:20.473840 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375070f1-3db5-4dfe-9dfa-fdbc9acde302 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:20.473971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375070f1-3db5-4dfe-9dfa-fdbc9acde302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:20.544413 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-375070f1-3db5-4dfe-9dfa-fdbc9acde302 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:20.545583 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-375070f1-3db5-4dfe-9dfa-fdbc9acde302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:20.680019 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:20.687412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 528/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:21.023626 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c4f4-560e-409d-b997-291945b4deec None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:21.025195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3ca1c4f4-560e-409d-b997-291945b4deec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:21.175700 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:21.187009 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c4f4-560e-409d-b997-291945b4deec None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:21.302875 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a85f6-44d5-42b9-92ba-f6f2ed9d903c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:21.303479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a85f6-44d5-42b9-92ba-f6f2ed9d903c service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:21.303786 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a85f6-44d5-42b9-92ba-f6f2ed9d903c service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:21.304022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a85f6-44d5-42b9-92ba-f6f2ed9d903c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:21.305636 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-5e2a85f6-44d5-42b9-92ba-f6f2ed9d903c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:21.401300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a85f6-44d5-42b9-92ba-f6f2ed9d903c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:21.402951 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a85f6-44d5-42b9-92ba-f6f2ed9d903c service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:21.413699 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:21.422446 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 531/1059] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:23.649073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936df53-50b1-472e-bb3d-3470f8299868 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:23.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936df53-50b1-472e-bb3d-3470f8299868 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:23.649819 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936df53-50b1-472e-bb3d-3470f8299868 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:23.651014 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 529/1060] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:23.656293 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8590a64-4626-407d-b0ad-5341c27effc1 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:23.656740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8590a64-4626-407d-b0ad-5341c27effc1 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:23.656930 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8590a64-4626-407d-b0ad-5341c27effc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:23.725420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-d8590a64-4626-407d-b0ad-5341c27effc1 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:23.726572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-d8590a64-4626-407d-b0ad-5341c27effc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:23.826077 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 532/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:24.115626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936df53-50b1-472e-bb3d-3470f8299868 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:24.117225 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9936df53-50b1-472e-bb3d-3470f8299868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:24.284595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936df53-50b1-472e-bb3d-3470f8299868 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:24.366006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:24.421468 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a6a03-d42f-4086-bf0a-69b6732bd441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:24.422091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6a03-d42f-4086-bf0a-69b6732bd441 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:24.422381 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6a03-d42f-4086-bf0a-69b6732bd441 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:24.422648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6a03-d42f-4086-bf0a-69b6732bd441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:24.425006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-308a6a03-d42f-4086-bf0a-69b6732bd441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:24.517640 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a6a03-d42f-4086-bf0a-69b6732bd441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:24.519246 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a6a03-d42f-4086-bf0a-69b6732bd441 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:24.540073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 530/1062] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:27.128098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523965-205b-41aa-9e67-5b0a45f512d9 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:27.128659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523965-205b-41aa-9e67-5b0a45f512d9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:27.128659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523965-205b-41aa-9e67-5b0a45f512d9 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:27.130155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 533/1063] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:27.135706 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d16c-d72e-4c05-b95e-ed94ae139db8 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:27.136211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d16c-d72e-4c05-b95e-ed94ae139db8 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:27.136318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d16c-d72e-4c05-b95e-ed94ae139db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:27.202350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-46b7d16c-d72e-4c05-b95e-ed94ae139db8 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:27.203402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-46b7d16c-d72e-4c05-b95e-ed94ae139db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:27.237354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:27.304409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 531/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:27.597790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523965-205b-41aa-9e67-5b0a45f512d9 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:27.599313 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-c8523965-205b-41aa-9e67-5b0a45f512d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:27.681153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:27.756584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523965-205b-41aa-9e67-5b0a45f512d9 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:27.870187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b2939-4611-422c-9cc1-41bbdc3e872a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:27.870726 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2939-4611-422c-9cc1-41bbdc3e872a service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:27.871005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2939-4611-422c-9cc1-41bbdc3e872a service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:27.871292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2939-4611-422c-9cc1-41bbdc3e872a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:27.872889 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-393b2939-4611-422c-9cc1-41bbdc3e872a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:27.912297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:27.964918 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b2939-4611-422c-9cc1-41bbdc3e872a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:27.966513 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b2939-4611-422c-9cc1-41bbdc3e872a service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:27.985977 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 534/1065] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:30.369805 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdae49-fa74-41d3-aebb-ae37f9a15361 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.370392 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdae49-fa74-41d3-aebb-ae37f9a15361 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.370392 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdae49-fa74-41d3-aebb-ae37f9a15361 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.371724 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 532/1066] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:30.377230 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272cd6-97a6-49f9-876e-753708bc2529 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:30.377666 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272cd6-97a6-49f9-876e-753708bc2529 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:30.377773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272cd6-97a6-49f9-876e-753708bc2529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:30.445129 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-dd272cd6-97a6-49f9-876e-753708bc2529 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:30.446336 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-dd272cd6-97a6-49f9-876e-753708bc2529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:30.543920 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 535/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:30.839938 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdae49-fa74-41d3-aebb-ae37f9a15361 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:30.841649 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-5cbdae49-fa74-41d3-aebb-ae37f9a15361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:31.014792 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdae49-fa74-41d3-aebb-ae37f9a15361 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:31.032722 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:31.132566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915cf59-83ea-4ac7-b582-4e4d834d0a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:31.133200 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915cf59-83ea-4ac7-b582-4e4d834d0a7a service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.133477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915cf59-83ea-4ac7-b582-4e4d834d0a7a service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.133745 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915cf59-83ea-4ac7-b582-4e4d834d0a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.135316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c915cf59-83ea-4ac7-b582-4e4d834d0a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:31.224756 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915cf59-83ea-4ac7-b582-4e4d834d0a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:31.226360 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915cf59-83ea-4ac7-b582-4e4d834d0a7a service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:31.244377 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 533/1068] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:31.864359 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8c01-3235-4156-8da9-e736dba1686d None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.864927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8c01-3235-4156-8da9-e736dba1686d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.864927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8c01-3235-4156-8da9-e736dba1686d None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.866283 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 536/1069] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:31.871533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0873c7-2d7d-4b79-abd4-a4772ed55bbc None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:31.871935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0873c7-2d7d-4b79-abd4-a4772ed55bbc None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:31.872206 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0873c7-2d7d-4b79-abd4-a4772ed55bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:31.898807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:31.946245 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-8b0873c7-2d7d-4b79-abd4-a4772ed55bbc None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:31.947459 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8b0873c7-2d7d-4b79-abd4-a4772ed55bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:32.046891 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 534/1070] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:32.353195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7b1ff-7833-4ade-bd6d-414cd13712eb None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.353553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7b1ff-7833-4ade-bd6d-414cd13712eb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.353990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7b1ff-7833-4ade-bd6d-414cd13712eb None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.355555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 537/1071] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 19 00:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:32.360518 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c0bb-2ae5-4196-b2bb-9d045b6dcb78 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.361006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c0bb-2ae5-4196-b2bb-9d045b6dcb78 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.361187 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c0bb-2ae5-4196-b2bb-9d045b6dcb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.443796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-d8b4c0bb-2ae5-4196-b2bb-9d045b6dcb78 None None] MFA Rules not processed for user `21e611c23e574338821093a7cd4a26be`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:32.445032 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d8b4c0bb-2ae5-4196-b2bb-9d045b6dcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:32.486424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.522355 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 535/1072] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 19 00:29:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:29:32.531368 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7b1ff-7833-4ade-bd6d-414cd13712eb None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:32.533005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-20e7b1ff-7833-4ade-bd6d-414cd13712eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:32.547096 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.641972 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7b1ff-7833-4ade-bd6d-414cd13712eb None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:32.717504 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cf2b9-c322-40dc-8ade-d1b7ef7ee7a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21e611c23e574338821093a7cd4a26be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:32.718122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf2b9-c322-40dc-8ade-d1b7ef7ee7a9 service glance] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:32.718399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf2b9-c322-40dc-8ade-d1b7ef7ee7a9 service glance] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:32.718673 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf2b9-c322-40dc-8ade-d1b7ef7ee7a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:32.720326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4b8cf2b9-c322-40dc-8ade-d1b7ef7ee7a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:32.790271 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:32.832030 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cf2b9-c322-40dc-8ade-d1b7ef7ee7a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:32.833482 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cf2b9-c322-40dc-8ade-d1b7ef7ee7a9 service glance] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:32.851788 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 538/1073] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:33.448280 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93004-7ed0-47fd-a740-a087405dc7ae None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.448882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93004-7ed0-47fd-a740-a087405dc7ae None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.448882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93004-7ed0-47fd-a740-a087405dc7ae None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.450212 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 536/1074] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:33.456332 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78ad16-1531-4f84-9cb2-8882dfca62d7 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.456903 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78ad16-1531-4f84-9cb2-8882dfca62d7 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.457237 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78ad16-1531-4f84-9cb2-8882dfca62d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-4f78ad16-1531-4f84-9cb2-8882dfca62d7 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:33.527647 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4f78ad16-1531-4f84-9cb2-8882dfca62d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:33.601034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540a69-75eb-4759-aa2d-0c45c7ac6bcb None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.601319 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540a69-75eb-4759-aa2d-0c45c7ac6bcb None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.601595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540a69-75eb-4759-aa2d-0c45c7ac6bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.631785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 539/1075] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:29:33.670001 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-95540a69-75eb-4759-aa2d-0c45c7ac6bcb None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:33.671191 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-95540a69-75eb-4759-aa2d-0c45c7ac6bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:33.755449 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 537/1076] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:29:33.801528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f4af5-cf3f-4ad2-93f9-29e0ff414bbd None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.801861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f4af5-cf3f-4ad2-93f9-29e0ff414bbd None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.802176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f4af5-cf3f-4ad2-93f9-29e0ff414bbd None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.803601 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 540/1077] 10.222.0.16 () {54 vars in 943 bytes} [Wed Oct 19 00:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:33.810081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9060d-1f0a-4707-813b-a78f93735e7f None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:33.810448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9060d-1f0a-4707-813b-a78f93735e7f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:33.810797 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9060d-1f0a-4707-813b-a78f93735e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:33.881389 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:33.889173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4ca9060d-1f0a-4707-813b-a78f93735e7f None None] MFA Rules not processed for user `1aa883a98a0343d2be532c739910fb13`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:33.890364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4ca9060d-1f0a-4707-813b-a78f93735e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:33.918942 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f4af5-cf3f-4ad2-93f9-29e0ff414bbd None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:33.920516 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-745f4af5-cf3f-4ad2-93f9-29e0ff414bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:33.967992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:34.009341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 538/1078] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Oct 19 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:34.019000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9060d-1f0a-4707-813b-a78f93735e7f None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:34.028496 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9060d-1f0a-4707-813b-a78f93735e7f None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:34.101184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f4af5-cf3f-4ad2-93f9-29e0ff414bbd None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:34.145103 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a748a26-69ca-4057-b9d7-90b48f48c6f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:34.145715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748a26-69ca-4057-b9d7-90b48f48c6f2 service swift] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:34.145993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748a26-69ca-4057-b9d7-90b48f48c6f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:34.146255 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748a26-69ca-4057-b9d7-90b48f48c6f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:34.147891 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9a748a26-69ca-4057-b9d7-90b48f48c6f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:34.150444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:34.201555 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:34.221760 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8998c-ed2a-40c0-afff-8adb841eaf7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:34.222364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8998c-ed2a-40c0-afff-8adb841eaf7b service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:34.222641 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8998c-ed2a-40c0-afff-8adb841eaf7b service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:34.222906 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8998c-ed2a-40c0-afff-8adb841eaf7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:34.224487 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-1de8998c-ed2a-40c0-afff-8adb841eaf7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:34.234189 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a748a26-69ca-4057-b9d7-90b48f48c6f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:34.236286 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a748a26-69ca-4057-b9d7-90b48f48c6f2 service swift] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:34.245276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 539/1079] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:29:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 00:29:34.320485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8998c-ed2a-40c0-afff-8adb841eaf7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:34.322152 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8998c-ed2a-40c0-afff-8adb841eaf7b service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:34.342153 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 541/1080] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:29:36.586674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256762-dbe4-4151-b8b3-9e36c4dfb38f None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.587301 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256762-dbe4-4151-b8b3-9e36c4dfb38f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.587301 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256762-dbe4-4151-b8b3-9e36c4dfb38f None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.588703 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 540/1081] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:36.594204 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71adc-f1ab-4340-82d6-f71c77e1bab5 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:36.594204 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71adc-f1ab-4340-82d6-f71c77e1bab5 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:36.594818 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71adc-f1ab-4340-82d6-f71c77e1bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:36.669048 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-9ce71adc-f1ab-4340-82d6-f71c77e1bab5 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:36.670273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9ce71adc-f1ab-4340-82d6-f71c77e1bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:36.749375 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:36.804435 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 542/1082] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:37.092976 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256762-dbe4-4151-b8b3-9e36c4dfb38f None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:37.094674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-69256762-dbe4-4151-b8b3-9e36c4dfb38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:37.256096 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:37.259670 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256762-dbe4-4151-b8b3-9e36c4dfb38f None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:37.424010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06368b2e-0b2b-41ca-8c4c-d09c0c9fffd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:37.425062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06368b2e-0b2b-41ca-8c4c-d09c0c9fffd1 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:37.425344 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06368b2e-0b2b-41ca-8c4c-d09c0c9fffd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:37.430735 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06368b2e-0b2b-41ca-8c4c-d09c0c9fffd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:37.430735 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-06368b2e-0b2b-41ca-8c4c-d09c0c9fffd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:37.551354 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06368b2e-0b2b-41ca-8c4c-d09c0c9fffd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:37.554876 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06368b2e-0b2b-41ca-8c4c-d09c0c9fffd1 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:37.575300 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 541/1083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:39.830520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0a2d8-e992-4b90-9826-28be330a7f82 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.831134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0a2d8-e992-4b90-9826-28be330a7f82 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.831134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0a2d8-e992-4b90-9826-28be330a7f82 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.832570 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 543/1084] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:39.837713 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e443a-eca8-49cf-bd26-8f529ddef4d9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:39.838202 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e443a-eca8-49cf-bd26-8f529ddef4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:39.838307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e443a-eca8-49cf-bd26-8f529ddef4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:39.843033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:39.917071 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-bc3e443a-eca8-49cf-bd26-8f529ddef4d9 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:39.918325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-bc3e443a-eca8-49cf-bd26-8f529ddef4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:40.037247 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 542/1085] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:40.323369 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0a2d8-e992-4b90-9826-28be330a7f82 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:29:40.324949 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9fe0a2d8-e992-4b90-9826-28be330a7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:40.491508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0a2d8-e992-4b90-9826-28be330a7f82 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:29:40.540797 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:40.626197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796b62-478e-4a51-a62b-c3ac0cd7536a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:29:40.626800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796b62-478e-4a51-a62b-c3ac0cd7536a service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:40.627084 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796b62-478e-4a51-a62b-c3ac0cd7536a service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:40.627359 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796b62-478e-4a51-a62b-c3ac0cd7536a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:40.629100 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e9796b62-478e-4a51-a62b-c3ac0cd7536a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:40.731587 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796b62-478e-4a51-a62b-c3ac0cd7536a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:29:40.733378 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796b62-478e-4a51-a62b-c3ac0cd7536a service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:29:40.757006 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 544/1086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:29:50.027465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=64 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:50.754239 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=79 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:57.026422 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a612c-3110-444c-ae41-c9b0a255bf6a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.027011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a612c-3110-444c-ae41-c9b0a255bf6a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.027011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a612c-3110-444c-ae41-c9b0a255bf6a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.028319 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 543/1087] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 19 00:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:57.033633 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd20f-c96d-42bc-9723-b89c8d078578 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.034125 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd20f-c96d-42bc-9723-b89c8d078578 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.034225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd20f-c96d-42bc-9723-b89c8d078578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.108874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3f0cd20f-c96d-42bc-9723-b89c8d078578 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:57.110727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3f0cd20f-c96d-42bc-9723-b89c8d078578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:57.215627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 545/1088] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 19 00:29:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:29:57.230081 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864619-4816-46f2-92a4-7eebf0bdbe41 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.230371 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864619-4816-46f2-92a4-7eebf0bdbe41 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.230650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864619-4816-46f2-92a4-7eebf0bdbe41 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.231977 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 544/1089] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 19 00:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:29:57.237546 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281fc97-7dc1-4faf-8481-7c3b45f07871 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:29:57.237834 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281fc97-7dc1-4faf-8481-7c3b45f07871 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:29:57.238115 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281fc97-7dc1-4faf-8481-7c3b45f07871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:29:57.310004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:29:57.312582 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3281fc97-7dc1-4faf-8481-7c3b45f07871 None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:29:57.314396 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3281fc97-7dc1-4faf-8481-7c3b45f07871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:29:57.428231 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 546/1090] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 19 00:29:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:30:00.005911 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043fdb-506a-44e7-8f53-ddeffe4db462 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.006445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043fdb-506a-44e7-8f53-ddeffe4db462 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.006445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043fdb-506a-44e7-8f53-ddeffe4db462 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.007791 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 545/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:00.013160 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f395f-980b-4894-a6ff-6d84fbda7d0e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.013589 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f395f-980b-4894-a6ff-6d84fbda7d0e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.013733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f395f-980b-4894-a6ff-6d84fbda7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.080296 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-278f395f-980b-4894-a6ff-6d84fbda7d0e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:00.081518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-278f395f-980b-4894-a6ff-6d84fbda7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:00.135565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.178696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 547/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:00.472425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a043fdb-506a-44e7-8f53-ddeffe4db462 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:00.474087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-6a043fdb-506a-44e7-8f53-ddeffe4db462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:00.618975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a043fdb-506a-44e7-8f53-ddeffe4db462 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:00.691516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:00.732286 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dd495-300c-41a0-9a12-3aea79b2bc35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:00.732812 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dd495-300c-41a0-9a12-3aea79b2bc35 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:00.733134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dd495-300c-41a0-9a12-3aea79b2bc35 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:00.733404 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dd495-300c-41a0-9a12-3aea79b2bc35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:00.735033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-0b7dd495-300c-41a0-9a12-3aea79b2bc35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:00.823505 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dd495-300c-41a0-9a12-3aea79b2bc35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:00.825113 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dd495-300c-41a0-9a12-3aea79b2bc35 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:00.843604 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 546/1093] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:01.984046 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8b8f-e071-49fa-b5d1-89ac2970f931 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:01.984714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8b8f-e071-49fa-b5d1-89ac2970f931 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:01.984714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8b8f-e071-49fa-b5d1-89ac2970f931 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:01.986142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 548/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:01.993477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055d92b-437a-4b39-9499-fcc949638869 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:01.994012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055d92b-437a-4b39-9499-fcc949638869 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:01.994444 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055d92b-437a-4b39-9499-fcc949638869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.085395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-3055d92b-437a-4b39-9499-fcc949638869 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:02.086771 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-3055d92b-437a-4b39-9499-fcc949638869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:02.117339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:02.193368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 547/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:02.350068 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd8b8f-e071-49fa-b5d1-89ac2970f931 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:02.351607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-26dd8b8f-e071-49fa-b5d1-89ac2970f931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:02.497169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd8b8f-e071-49fa-b5d1-89ac2970f931 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:02.536485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:02.610953 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e1202-ec5a-45dc-9763-a50ba9f3456b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:02.611560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1202-ec5a-45dc-9763-a50ba9f3456b service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:02.611846 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1202-ec5a-45dc-9763-a50ba9f3456b service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:02.612116 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e1202-ec5a-45dc-9763-a50ba9f3456b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:02.613810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e50e1202-ec5a-45dc-9763-a50ba9f3456b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:02.703796 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e1202-ec5a-45dc-9763-a50ba9f3456b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:02.705431 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e1202-ec5a-45dc-9763-a50ba9f3456b service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:02.723698 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 549/1096] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:03.850230 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2a9e-e6dd-45bf-b8a1-250654dab3b0 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:03.850794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2a9e-e6dd-45bf-b8a1-250654dab3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:03.850794 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2a9e-e6dd-45bf-b8a1-250654dab3b0 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:03.852141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 548/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:03.858127 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253babb-cd60-496d-86ad-79a7565b57a5 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:03.858519 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253babb-cd60-496d-86ad-79a7565b57a5 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:03.858674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253babb-cd60-496d-86ad-79a7565b57a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:03.912812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:03.935272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-e253babb-cd60-496d-86ad-79a7565b57a5 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:03.936470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e253babb-cd60-496d-86ad-79a7565b57a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:04.038946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 550/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:04.194948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2a9e-e6dd-45bf-b8a1-250654dab3b0 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:04.196402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-145b2a9e-e6dd-45bf-b8a1-250654dab3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:04.340512 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2a9e-e6dd-45bf-b8a1-250654dab3b0 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:04.352912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:04.453902 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e49ad9-28ee-494e-81e8-ddce8b07fdf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:04.454418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e49ad9-28ee-494e-81e8-ddce8b07fdf9 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:04.454692 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e49ad9-28ee-494e-81e8-ddce8b07fdf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:04.454958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e49ad9-28ee-494e-81e8-ddce8b07fdf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:04.456528 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e8e49ad9-28ee-494e-81e8-ddce8b07fdf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:04.547391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e49ad9-28ee-494e-81e8-ddce8b07fdf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:04.549065 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e49ad9-28ee-494e-81e8-ddce8b07fdf9 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:04.566888 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 549/1099] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:05.677817 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66502a-6dae-4d56-a813-7eb16edc516f None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:05.678353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66502a-6dae-4d56-a813-7eb16edc516f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:05.678353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66502a-6dae-4d56-a813-7eb16edc516f None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:05.679720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 551/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:05.686024 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052e38-fc47-4449-ac5e-c8a207b8a627 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:05.686485 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052e38-fc47-4449-ac5e-c8a207b8a627 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:05.686590 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052e38-fc47-4449-ac5e-c8a207b8a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:05.706507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:05.762331 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-fd052e38-fc47-4449-ac5e-c8a207b8a627 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:05.763534 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-fd052e38-fc47-4449-ac5e-c8a207b8a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:05.858947 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 550/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:06.007753 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66502a-6dae-4d56-a813-7eb16edc516f None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:06.009367 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-cf66502a-6dae-4d56-a813-7eb16edc516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:06.119297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:06.154140 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66502a-6dae-4d56-a813-7eb16edc516f None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:06.264884 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4469608-9c0b-4eb0-aa9e-854774994346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:06.266006 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469608-9c0b-4eb0-aa9e-854774994346 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:06.266287 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469608-9c0b-4eb0-aa9e-854774994346 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:06.266558 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469608-9c0b-4eb0-aa9e-854774994346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:06.268130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-f4469608-9c0b-4eb0-aa9e-854774994346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:06.343161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:06.357191 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4469608-9c0b-4eb0-aa9e-854774994346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:06.358793 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4469608-9c0b-4eb0-aa9e-854774994346 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:06.376411 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 552/1102] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:07.485000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546457a-a2c6-446f-8312-a06435c68b4c None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:07.485542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546457a-a2c6-446f-8312-a06435c68b4c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:07.485542 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546457a-a2c6-446f-8312-a06435c68b4c None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:07.486900 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 551/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:07.493117 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750bb6-c375-4610-8b7a-d7dc81183a4e None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:07.493511 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750bb6-c375-4610-8b7a-d7dc81183a4e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:07.493672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750bb6-c375-4610-8b7a-d7dc81183a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:07.569612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-65750bb6-c375-4610-8b7a-d7dc81183a4e None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:07.570799 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-65750bb6-c375-4610-8b7a-d7dc81183a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:07.666257 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 553/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:07.815021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546457a-a2c6-446f-8312-a06435c68b4c None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:07.816507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4546457a-a2c6-446f-8312-a06435c68b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:07.898069 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:07.961033 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546457a-a2c6-446f-8312-a06435c68b4c None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:08.072570 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa36b9-3bdb-49fe-ae6b-4fe1353fe929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:08.073155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa36b9-3bdb-49fe-ae6b-4fe1353fe929 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:08.073434 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa36b9-3bdb-49fe-ae6b-4fe1353fe929 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:08.073705 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa36b9-3bdb-49fe-ae6b-4fe1353fe929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:08.075297 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c0aa36b9-3bdb-49fe-ae6b-4fe1353fe929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:08.123164 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:08.163460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa36b9-3bdb-49fe-ae6b-4fe1353fe929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:08.165066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa36b9-3bdb-49fe-ae6b-4fe1353fe929 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:08.182965 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 552/1105] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:09.226684 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e832fd2-b1b3-4ff2-9310-7e6312ed73f6 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:09.227227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e832fd2-b1b3-4ff2-9310-7e6312ed73f6 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:09.227227 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e832fd2-b1b3-4ff2-9310-7e6312ed73f6 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:09.228489 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 554/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:09.235277 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcae23-c4b9-4c1d-a992-69b169ab8906 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:09.235736 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcae23-c4b9-4c1d-a992-69b169ab8906 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:09.235854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcae23-c4b9-4c1d-a992-69b169ab8906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:09.310052 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-48bcae23-c4b9-4c1d-a992-69b169ab8906 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:09.311244 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-48bcae23-c4b9-4c1d-a992-69b169ab8906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:09.412193 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 553/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:09.562563 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e832fd2-b1b3-4ff2-9310-7e6312ed73f6 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:09.564067 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6e832fd2-b1b3-4ff2-9310-7e6312ed73f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:09.613158 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:09.710175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e832fd2-b1b3-4ff2-9310-7e6312ed73f6 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:09.822607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a5ad-9581-456a-a591-7cdc976749b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:09.823225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a5ad-9581-456a-a591-7cdc976749b6 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:09.823507 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a5ad-9581-456a-a591-7cdc976749b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:09.823781 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a5ad-9581-456a-a591-7cdc976749b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:09.825412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-36e2a5ad-9581-456a-a591-7cdc976749b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:09.833118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:09.915479 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a5ad-9581-456a-a591-7cdc976749b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:09.917130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a5ad-9581-456a-a591-7cdc976749b6 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:09.935687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 555/1108] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:10.994497 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ad83-b05f-4536-bc8d-d955ce7f8d51 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:10.995014 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ad83-b05f-4536-bc8d-d955ce7f8d51 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:10.995122 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ad83-b05f-4536-bc8d-d955ce7f8d51 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:10.996385 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 554/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:11.003290 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a8cd-c47f-4c92-aced-ad9f2990f7fa None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:11.003731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a8cd-c47f-4c92-aced-ad9f2990f7fa None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:11.003828 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a8cd-c47f-4c92-aced-ad9f2990f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:11.080779 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-12b2a8cd-c47f-4c92-aced-ad9f2990f7fa None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:11.082037 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-12b2a8cd-c47f-4c92-aced-ad9f2990f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:11.150163 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:11.179286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 556/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:30:11.331908 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32ad83-b05f-4536-bc8d-d955ce7f8d51 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:11.333455 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8f32ad83-b05f-4536-bc8d-d955ce7f8d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:11.350909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:11.482836 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32ad83-b05f-4536-bc8d-d955ce7f8d51 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:11.570949 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:11.597039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6d13-9a21-4fef-97c0-8d3a1f9cea7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:11.597643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6d13-9a21-4fef-97c0-8d3a1f9cea7c service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:11.597921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6d13-9a21-4fef-97c0-8d3a1f9cea7c service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:11.598190 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6d13-9a21-4fef-97c0-8d3a1f9cea7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:11.599768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b3bd6d13-9a21-4fef-97c0-8d3a1f9cea7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:11.689392 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6d13-9a21-4fef-97c0-8d3a1f9cea7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:11.690959 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6d13-9a21-4fef-97c0-8d3a1f9cea7c service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:11.708420 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 555/1111] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:12.777056 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0208c2-eb79-4542-8c75-e492aaa14db0 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:12.777603 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0208c2-eb79-4542-8c75-e492aaa14db0 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:12.777603 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0208c2-eb79-4542-8c75-e492aaa14db0 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:12.778883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 557/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:12.786061 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a7b6-22c4-4d0f-b4a7-caecc6737aae None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:12.786522 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a7b6-22c4-4d0f-b4a7-caecc6737aae None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:12.786624 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a7b6-22c4-4d0f-b4a7-caecc6737aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:12.862561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-fb27a7b6-22c4-4d0f-b4a7-caecc6737aae None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:12.863760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-fb27a7b6-22c4-4d0f-b4a7-caecc6737aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:12.903576 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:12.958701 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 556/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:13.109209 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0208c2-eb79-4542-8c75-e492aaa14db0 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:13.110699 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9b0208c2-eb79-4542-8c75-e492aaa14db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:13.254044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0208c2-eb79-4542-8c75-e492aaa14db0 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:13.307887 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:13.366692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b76c9f-9e67-4a10-b0ef-782dab006e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:13.367297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b76c9f-9e67-4a10-b0ef-782dab006e50 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:13.367581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b76c9f-9e67-4a10-b0ef-782dab006e50 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:13.367858 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b76c9f-9e67-4a10-b0ef-782dab006e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:13.369490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-66b76c9f-9e67-4a10-b0ef-782dab006e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:13.460119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b76c9f-9e67-4a10-b0ef-782dab006e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:13.461800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b76c9f-9e67-4a10-b0ef-782dab006e50 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:13.479770 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 558/1114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:14.537903 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e12d0-82f9-4107-9fd3-e1da67315d67 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:14.538414 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e12d0-82f9-4107-9fd3-e1da67315d67 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:14.538526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e12d0-82f9-4107-9fd3-e1da67315d67 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:14.539863 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 557/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:14.545915 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5ead-4dc8-4813-96f8-8cbd7a10ee6b None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:14.546362 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5ead-4dc8-4813-96f8-8cbd7a10ee6b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:14.547008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5ead-4dc8-4813-96f8-8cbd7a10ee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:14.623945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-95da5ead-4dc8-4813-96f8-8cbd7a10ee6b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:14.625787 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-95da5ead-4dc8-4813-96f8-8cbd7a10ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:14.627800 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:14.721292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 559/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:14.869644 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e12d0-82f9-4107-9fd3-e1da67315d67 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:14.871155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-384e12d0-82f9-4107-9fd3-e1da67315d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:15.018330 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e12d0-82f9-4107-9fd3-e1da67315d67 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:15.044584 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:15.130552 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922063-3128-443b-92ca-7ee18969c3eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:15.131157 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922063-3128-443b-92ca-7ee18969c3eb service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:15.131435 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922063-3128-443b-92ca-7ee18969c3eb service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:15.131742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922063-3128-443b-92ca-7ee18969c3eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:15.133380 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b7922063-3128-443b-92ca-7ee18969c3eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:15.222785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7922063-3128-443b-92ca-7ee18969c3eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:15.224359 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7922063-3128-443b-92ca-7ee18969c3eb service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:15.242333 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 558/1117] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:17.290713 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93c286-7540-4501-8bf9-8f340169e151 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:17.291269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93c286-7540-4501-8bf9-8f340169e151 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:17.291269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93c286-7540-4501-8bf9-8f340169e151 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:17.292622 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 560/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:17.298607 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203e77-7eb3-4aca-89f7-23225c77e9e0 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:17.299008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203e77-7eb3-4aca-89f7-23225c77e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:17.299173 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203e77-7eb3-4aca-89f7-23225c77e9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:17.339958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:17.366405 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-34203e77-7eb3-4aca-89f7-23225c77e9e0 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:17.367616 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-34203e77-7eb3-4aca-89f7-23225c77e9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:17.461943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 559/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:17.751491 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93c286-7540-4501-8bf9-8f340169e151 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:17.753077 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-1c93c286-7540-4501-8bf9-8f340169e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:17.857720 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93c286-7540-4501-8bf9-8f340169e151 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:17.891083 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:17.932213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf26832-1b72-44f4-b9c4-8301e4d7110d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:17.932826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf26832-1b72-44f4-b9c4-8301e4d7110d service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:17.933134 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf26832-1b72-44f4-b9c4-8301e4d7110d service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:17.933774 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf26832-1b72-44f4-b9c4-8301e4d7110d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:17.935009 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3cf26832-1b72-44f4-b9c4-8301e4d7110d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:18.044608 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf26832-1b72-44f4-b9c4-8301e4d7110d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:18.046092 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf26832-1b72-44f4-b9c4-8301e4d7110d service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:18.064342 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 561/1120] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:20.366182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee97550-927b-40ec-9d15-1f991f036ede None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:20.366741 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee97550-927b-40ec-9d15-1f991f036ede None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:20.366741 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee97550-927b-40ec-9d15-1f991f036ede None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:20.368135 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 560/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:20.373251 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6983-6fce-4171-925d-1656152b01c4 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:20.373671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6983-6fce-4171-925d-1656152b01c4 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:20.373801 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6983-6fce-4171-925d-1656152b01c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:20.441550 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-1e9e6983-6fce-4171-925d-1656152b01c4 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:20.442755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-1e9e6983-6fce-4171-925d-1656152b01c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:20.456073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:20.543263 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 562/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:20.831845 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee97550-927b-40ec-9d15-1f991f036ede None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:20.833417 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-cee97550-927b-40ec-9d15-1f991f036ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:20.937536 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee97550-927b-40ec-9d15-1f991f036ede None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:20.950533 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:21.012550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb12a70-5ccd-4b8b-8dbc-2edde1ec107d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:21.013197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb12a70-5ccd-4b8b-8dbc-2edde1ec107d service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:21.013475 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb12a70-5ccd-4b8b-8dbc-2edde1ec107d service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:21.013747 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb12a70-5ccd-4b8b-8dbc-2edde1ec107d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:21.015359 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-dbb12a70-5ccd-4b8b-8dbc-2edde1ec107d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:21.123047 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb12a70-5ccd-4b8b-8dbc-2edde1ec107d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:21.124438 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb12a70-5ccd-4b8b-8dbc-2edde1ec107d service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:21.143395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 561/1123] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:23.596468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6838-6d87-4fec-a138-faabb5ef26c4 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:23.597036 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6838-6d87-4fec-a138-faabb5ef26c4 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:23.597036 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6838-6d87-4fec-a138-faabb5ef26c4 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:23.598382 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 563/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:23.603868 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a173-70c0-4e85-9039-3b6782d82d90 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:23.604295 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a173-70c0-4e85-9039-3b6782d82d90 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:23.604445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a173-70c0-4e85-9039-3b6782d82d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:23.651906 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:23.670718 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-03b8a173-70c0-4e85-9039-3b6782d82d90 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:23.671998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-03b8a173-70c0-4e85-9039-3b6782d82d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:23.766594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 562/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:24.053112 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6838-6d87-4fec-a138-faabb5ef26c4 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:24.054700 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-631a6838-6d87-4fec-a138-faabb5ef26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:24.164320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6838-6d87-4fec-a138-faabb5ef26c4 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:24.205484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:24.241518 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74ea6-12c3-4c0c-950b-03a4c9fbc4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:24.242118 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74ea6-12c3-4c0c-950b-03a4c9fbc4fc service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:24.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74ea6-12c3-4c0c-950b-03a4c9fbc4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:24.242668 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74ea6-12c3-4c0c-950b-03a4c9fbc4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:24.244241 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-77d74ea6-12c3-4c0c-950b-03a4c9fbc4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:24.355484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74ea6-12c3-4c0c-950b-03a4c9fbc4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:24.356931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74ea6-12c3-4c0c-950b-03a4c9fbc4fc service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:24.375262 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 564/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:26.661303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11755f-d142-439d-83fc-bcebe7af7c80 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:26.661857 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11755f-d142-439d-83fc-bcebe7af7c80 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:26.661857 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11755f-d142-439d-83fc-bcebe7af7c80 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:26.663460 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 563/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:26.668919 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cb586-1592-40bf-85df-3c0800dcb564 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:26.669384 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cb586-1592-40bf-85df-3c0800dcb564 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:26.669480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cb586-1592-40bf-85df-3c0800dcb564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:26.734835 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-996cb586-1592-40bf-85df-3c0800dcb564 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:26.735992 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-996cb586-1592-40bf-85df-3c0800dcb564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:26.755968 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:26.834439 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 565/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:27.120021 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11755f-d142-439d-83fc-bcebe7af7c80 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:27.121572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-ad11755f-d142-439d-83fc-bcebe7af7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:27.225443 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11755f-d142-439d-83fc-bcebe7af7c80 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:27.246308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:27.299783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa107-3e37-4b3f-b1ab-6787dfd404ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:27.300396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa107-3e37-4b3f-b1ab-6787dfd404ae service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:27.300688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa107-3e37-4b3f-b1ab-6787dfd404ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:27.300975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa107-3e37-4b3f-b1ab-6787dfd404ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:27.302565 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-40baa107-3e37-4b3f-b1ab-6787dfd404ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:27.410937 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa107-3e37-4b3f-b1ab-6787dfd404ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:27.412631 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa107-3e37-4b3f-b1ab-6787dfd404ae service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:27.430895 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 564/1129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:29.634578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026af24-4372-40f4-af86-28c7dd9d94ea None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:29.635115 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026af24-4372-40f4-af86-28c7dd9d94ea None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:29.635235 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026af24-4372-40f4-af86-28c7dd9d94ea None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:29.636508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 566/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:29.642561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d78e5b-3aa8-40dd-8df6-1ed035781db3 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:29.642983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d78e5b-3aa8-40dd-8df6-1ed035781db3 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:29.643087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d78e5b-3aa8-40dd-8df6-1ed035781db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:29.706263 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:29.709722 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-54d78e5b-3aa8-40dd-8df6-1ed035781db3 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:29.711107 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-54d78e5b-3aa8-40dd-8df6-1ed035781db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:29.811953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 565/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:30.110639 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026af24-4372-40f4-af86-28c7dd9d94ea None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:30.112174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3026af24-4372-40f4-af86-28c7dd9d94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:30.216280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026af24-4372-40f4-af86-28c7dd9d94ea None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:30.266729 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:30.291963 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cad04-0d84-4154-9378-208c4ebf91df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:30.292568 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cad04-0d84-4154-9378-208c4ebf91df service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:30.292878 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cad04-0d84-4154-9378-208c4ebf91df service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:30.293149 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cad04-0d84-4154-9378-208c4ebf91df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:30.294733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ad9cad04-0d84-4154-9378-208c4ebf91df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:30.403537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cad04-0d84-4154-9378-208c4ebf91df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:30.404988 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cad04-0d84-4154-9378-208c4ebf91df service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:30.423979 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 567/1132] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:32.751612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb642-d95f-48ae-98c6-06db4d2b938a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:32.752166 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb642-d95f-48ae-98c6-06db4d2b938a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:32.752166 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb642-d95f-48ae-98c6-06db4d2b938a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:32.753516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 566/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:32.758752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53500f-1c3f-4292-ba12-40bc6333f239 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:32.759169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53500f-1c3f-4292-ba12-40bc6333f239 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:32.759358 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53500f-1c3f-4292-ba12-40bc6333f239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:32.825844 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3b53500f-1c3f-4292-ba12-40bc6333f239 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:32.826584 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3b53500f-1c3f-4292-ba12-40bc6333f239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:32.855752 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:32.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 568/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:33.208402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91beb642-d95f-48ae-98c6-06db4d2b938a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:33.209978 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-91beb642-d95f-48ae-98c6-06db4d2b938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:33.313318 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91beb642-d95f-48ae-98c6-06db4d2b938a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:33.340993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:33.388097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bcf72-9b13-45f5-a65c-ebf0229787c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:33.388697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bcf72-9b13-45f5-a65c-ebf0229787c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:33.389015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bcf72-9b13-45f5-a65c-ebf0229787c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:33.389284 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bcf72-9b13-45f5-a65c-ebf0229787c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:33.391045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-371bcf72-9b13-45f5-a65c-ebf0229787c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:33.499086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bcf72-9b13-45f5-a65c-ebf0229787c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:33.500924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bcf72-9b13-45f5-a65c-ebf0229787c4 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:33.518554 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 567/1135] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:35.733972 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147efcd-3692-409c-a01d-3d82bd3e470d None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:35.734535 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147efcd-3692-409c-a01d-3d82bd3e470d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:35.734665 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147efcd-3692-409c-a01d-3d82bd3e470d None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:35.736016 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 569/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:35.741525 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f447b1f-d8e4-42b8-86a6-568387c59975 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:35.741909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f447b1f-d8e4-42b8-86a6-568387c59975 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:35.742075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f447b1f-d8e4-42b8-86a6-568387c59975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:35.808879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-8f447b1f-d8e4-42b8-86a6-568387c59975 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:35.810130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8f447b1f-d8e4-42b8-86a6-568387c59975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:35.819653 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:35.907988 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 568/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:36.194762 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147efcd-3692-409c-a01d-3d82bd3e470d None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:36.196321 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4147efcd-3692-409c-a01d-3d82bd3e470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:36.302465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147efcd-3692-409c-a01d-3d82bd3e470d None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:36.358391 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:36.376588 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c219d-5579-43d5-8a6b-d133017d60f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:36.377221 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c219d-5579-43d5-8a6b-d133017d60f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:36.377500 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c219d-5579-43d5-8a6b-d133017d60f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:36.377770 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c219d-5579-43d5-8a6b-d133017d60f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:36.379343 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-af6c219d-5579-43d5-8a6b-d133017d60f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:36.488318 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c219d-5579-43d5-8a6b-d133017d60f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:36.489816 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c219d-5579-43d5-8a6b-d133017d60f6 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:36.507353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 570/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:38.728970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b5271-2411-4696-89a9-9970e2cf569b None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:38.729477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b5271-2411-4696-89a9-9970e2cf569b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:38.729477 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b5271-2411-4696-89a9-9970e2cf569b None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:38.730780 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:38.736225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ad3e-2c6e-423c-9ec4-6b213d0cae7f None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:38.736667 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ad3e-2c6e-423c-9ec4-6b213d0cae7f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:38.736789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ad3e-2c6e-423c-9ec4-6b213d0cae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:38.803556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3127ad3e-2c6e-423c-9ec4-6b213d0cae7f None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:38.804755 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3127ad3e-2c6e-423c-9ec4-6b213d0cae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:38.843420 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:38.901218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:39.185877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b5271-2411-4696-89a9-9970e2cf569b None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:39.188091 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-aa9b5271-2411-4696-89a9-9970e2cf569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:39.291636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b5271-2411-4696-89a9-9970e2cf569b None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:39.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:39.367669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaccc5c-e427-4164-a2fb-cfcab261458a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:39.368279 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaccc5c-e427-4164-a2fb-cfcab261458a service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:39.368555 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaccc5c-e427-4164-a2fb-cfcab261458a service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:39.368825 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaccc5c-e427-4164-a2fb-cfcab261458a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:39.370426 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-6aaccc5c-e427-4164-a2fb-cfcab261458a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:39.480683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaccc5c-e427-4164-a2fb-cfcab261458a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:39.482070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaccc5c-e427-4164-a2fb-cfcab261458a service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:39.500553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 570/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:41.721412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fe24-82ee-409f-8c8b-31376b7abf09 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:41.721985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fe24-82ee-409f-8c8b-31376b7abf09 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:41.721985 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fe24-82ee-409f-8c8b-31376b7abf09 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:41.723313 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:41.729006 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e091e54-41a3-4b86-b60b-394ebf7d4e43 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:41.729430 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e091e54-41a3-4b86-b60b-394ebf7d4e43 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:41.729554 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e091e54-41a3-4b86-b60b-394ebf7d4e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:41.799695 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-2e091e54-41a3-4b86-b60b-394ebf7d4e43 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:41.800936 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2e091e54-41a3-4b86-b60b-394ebf7d4e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:41.820855 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:41.903854 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:42.195300 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09fe24-82ee-409f-8c8b-31376b7abf09 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:42.196931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-be09fe24-82ee-409f-8c8b-31376b7abf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:42.306230 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09fe24-82ee-409f-8c8b-31376b7abf09 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:42.376723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:42.383768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8bcb2-fafc-4be3-98db-dd414c28e809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:42.384383 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8bcb2-fafc-4be3-98db-dd414c28e809 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:42.384664 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8bcb2-fafc-4be3-98db-dd414c28e809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:42.384976 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8bcb2-fafc-4be3-98db-dd414c28e809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:42.386575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-abc8bcb2-fafc-4be3-98db-dd414c28e809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:42.501078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8bcb2-fafc-4be3-98db-dd414c28e809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:42.502639 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8bcb2-fafc-4be3-98db-dd414c28e809 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:42.520730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 573/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:44.769132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ba353-7720-4aec-a493-5a73a3edbf37 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:44.769638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ba353-7720-4aec-a493-5a73a3edbf37 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:44.769638 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ba353-7720-4aec-a493-5a73a3edbf37 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:44.770964 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:30:44.776362 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3caa-e0b3-48f7-ab4d-f561e19ec870 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:44.776794 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3caa-e0b3-48f7-ab4d-f561e19ec870 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:44.777063 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3caa-e0b3-48f7-ab4d-f561e19ec870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:44.847429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-36da3caa-e0b3-48f7-ab4d-f561e19ec870 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:30:44.848626 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-36da3caa-e0b3-48f7-ab4d-f561e19ec870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:44.898843 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:44.951137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:30:45.234302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ba353-7720-4aec-a493-5a73a3edbf37 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:30:45.235824 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2b1ba353-7720-4aec-a493-5a73a3edbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:45.342803 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ba353-7720-4aec-a493-5a73a3edbf37 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:30:45.392070 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:45.418526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4558d07-ebf7-411a-976a-8046937931d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:30:45.419134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4558d07-ebf7-411a-976a-8046937931d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:30:45.419410 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4558d07-ebf7-411a-976a-8046937931d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:30:45.419679 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4558d07-ebf7-411a-976a-8046937931d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:30:45.421816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-f4558d07-ebf7-411a-976a-8046937931d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:30:45.534406 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4558d07-ebf7-411a-976a-8046937931d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:30:45.535837 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4558d07-ebf7-411a-976a-8046937931d3 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:30:45.555110 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 573/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:30:54.949630 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=22 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:30:55.552986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=66 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:05.644591 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6c8c2-0243-4406-aec1-85a9660a0ee5 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:05.645176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6c8c2-0243-4406-aec1-85a9660a0ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:05.645176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6c8c2-0243-4406-aec1-85a9660a0ee5 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:05.646508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 575/1148] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:05.651798 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea691-675f-4d48-998e-e5e9e8cbc25c None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:05.652236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea691-675f-4d48-998e-e5e9e8cbc25c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:05.652343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea691-675f-4d48-998e-e5e9e8cbc25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:05.718785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-ff5ea691-675f-4d48-998e-e5e9e8cbc25c None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:05.719971 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-ff5ea691-675f-4d48-998e-e5e9e8cbc25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:05.815325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 574/1149] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:06.111269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921834b-a73f-4623-a3fb-37413781fd96 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:06.111552 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921834b-a73f-4623-a3fb-37413781fd96 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:06.111822 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921834b-a73f-4623-a3fb-37413781fd96 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:06.113213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 576/1150] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 19 00:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:06.118227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa697e-3070-447b-bc09-be765bac96af None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:06.118510 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa697e-3070-447b-bc09-be765bac96af None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:06.118781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa697e-3070-447b-bc09-be765bac96af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:06.195401 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4baa697e-3070-447b-bc09-be765bac96af None None] MFA Rules not processed for user `21e611c23e574338821093a7cd4a26be`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:06.196526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4baa697e-3070-447b-bc09-be765bac96af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:06.217717 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:06.273041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 575/1151] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 19 00:31:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:06.280727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921834b-a73f-4623-a3fb-37413781fd96 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:06.282262 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e921834b-a73f-4623-a3fb-37413781fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:06.384696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921834b-a73f-4623-a3fb-37413781fd96 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:06.456990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8b0f5-a0c7-41bb-866e-e8ce9664fcec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21e611c23e574338821093a7cd4a26be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:06.457523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b0f5-a0c7-41bb-866e-e8ce9664fcec service glance] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:06.457808 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b0f5-a0c7-41bb-866e-e8ce9664fcec service glance] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:06.458080 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b0f5-a0c7-41bb-866e-e8ce9664fcec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:06.459667 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a0b8b0f5-a0c7-41bb-866e-e8ce9664fcec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:06.513517 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:06.569187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8b0f5-a0c7-41bb-866e-e8ce9664fcec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:06.570591 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8b0f5-a0c7-41bb-866e-e8ce9664fcec service glance] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:06.588706 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 577/1152] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:08.851465 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56e77-8d00-44f2-9611-145a5522212e None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:08.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56e77-8d00-44f2-9611-145a5522212e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:08.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56e77-8d00-44f2-9611-145a5522212e None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:08.853383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 576/1153] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:08.858528 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82957e2-4171-44c6-b10d-6b170fe7eccf None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:08.858928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82957e2-4171-44c6-b10d-6b170fe7eccf None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:08.859075 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82957e2-4171-44c6-b10d-6b170fe7eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:08.924352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-b82957e2-4171-44c6-b10d-6b170fe7eccf None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:08.925587 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-b82957e2-4171-44c6-b10d-6b170fe7eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:09.021619 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 578/1154] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:09.293512 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce56e77-8d00-44f2-9611-145a5522212e None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:09.295084 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-cce56e77-8d00-44f2-9611-145a5522212e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:09.418909 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce56e77-8d00-44f2-9611-145a5522212e None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:09.467405 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:09.509710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475f157-e065-4e3b-b2ff-51db66eaa94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:09.510311 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f157-e065-4e3b-b2ff-51db66eaa94f admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:09.510584 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f157-e065-4e3b-b2ff-51db66eaa94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:09.510846 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f157-e065-4e3b-b2ff-51db66eaa94f admin admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:09.511472 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475f157-e065-4e3b-b2ff-51db66eaa94f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:09.512561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-9475f157-e065-4e3b-b2ff-51db66eaa94f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:31:09.512561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:31:09.512561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:31:09.513715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475f157-e065-4e3b-b2ff-51db66eaa94f admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:09.533181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 577/1155] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 00:31:09 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:31:11.723733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce045-fc0a-4385-ad67-0cb0ecf44f1e None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:11.724378 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce045-fc0a-4385-ad67-0cb0ecf44f1e None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:11.724378 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce045-fc0a-4385-ad67-0cb0ecf44f1e None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:11.725696 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 579/1156] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:11.731010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cee3d-0615-4146-af7c-9c5a81458ca9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:11.731454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cee3d-0615-4146-af7c-9c5a81458ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:11.731566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cee3d-0615-4146-af7c-9c5a81458ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:11.798391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4f1cee3d-0615-4146-af7c-9c5a81458ca9 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:11.799609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4f1cee3d-0615-4146-af7c-9c5a81458ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:11.895302 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 578/1157] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:12.194342 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce045-fc0a-4385-ad67-0cb0ecf44f1e None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:12.195876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-871ce045-fc0a-4385-ad67-0cb0ecf44f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:12.206577 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:12.340410 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce045-fc0a-4385-ad67-0cb0ecf44f1e None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:12.419991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:12.453575 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48ee3-47be-407a-994b-78c924b90fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:12.454107 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48ee3-47be-407a-994b-78c924b90fd4 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:12.454388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48ee3-47be-407a-994b-78c924b90fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:12.454656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48ee3-47be-407a-994b-78c924b90fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:12.456232 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e3f48ee3-47be-407a-994b-78c924b90fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:12.543856 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48ee3-47be-407a-994b-78c924b90fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:12.545458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48ee3-47be-407a-994b-78c924b90fd4 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:12.564008 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 580/1158] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:14.894137 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972544-f652-4d0e-a44d-75dcc0cd759c None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:14.894719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972544-f652-4d0e-a44d-75dcc0cd759c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:14.894719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972544-f652-4d0e-a44d-75dcc0cd759c None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:14.896060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 579/1159] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:14.901489 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2671-26f7-4c31-9e60-302725dbf13a None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:14.901930 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2671-26f7-4c31-9e60-302725dbf13a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:14.902034 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2671-26f7-4c31-9e60-302725dbf13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:14.968503 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-a50e2671-26f7-4c31-9e60-302725dbf13a None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:14.969740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a50e2671-26f7-4c31-9e60-302725dbf13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:15.015392 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:15.065904 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 581/1160] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:15.354760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972544-f652-4d0e-a44d-75dcc0cd759c None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:15.356274 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c2972544-f652-4d0e-a44d-75dcc0cd759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:15.380541 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:15.458119 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972544-f652-4d0e-a44d-75dcc0cd759c None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:15.528992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c481bc1-dc6d-43cc-a058-45821b93cd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:15.529585 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c481bc1-dc6d-43cc-a058-45821b93cd27 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:15.529858 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c481bc1-dc6d-43cc-a058-45821b93cd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:15.530145 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c481bc1-dc6d-43cc-a058-45821b93cd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:15.532243 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9c481bc1-dc6d-43cc-a058-45821b93cd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:15.607697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:15.643724 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c481bc1-dc6d-43cc-a058-45821b93cd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:15.645174 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c481bc1-dc6d-43cc-a058-45821b93cd27 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:15.662976 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 580/1161] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:17.850296 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d919-1d86-4768-b6b9-14b365df0277 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:17.850868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d919-1d86-4768-b6b9-14b365df0277 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:17.850868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d919-1d86-4768-b6b9-14b365df0277 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:17.852175 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 582/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:17.857390 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb9fa4-e30a-447e-afea-4d7cb095ed8a None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:17.857776 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb9fa4-e30a-447e-afea-4d7cb095ed8a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:17.857973 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb9fa4-e30a-447e-afea-4d7cb095ed8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:17.924845 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-a7cb9fa4-e30a-447e-afea-4d7cb095ed8a None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:17.926073 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-a7cb9fa4-e30a-447e-afea-4d7cb095ed8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:18.025031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 581/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:18.325890 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d919-1d86-4768-b6b9-14b365df0277 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:18.327438 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4533d919-1d86-4768-b6b9-14b365df0277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:18.433005 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d919-1d86-4768-b6b9-14b365df0277 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:18.505789 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:18.507274 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e7fc5-4247-4888-b8c8-27d6705443f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:18.507884 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7fc5-4247-4888-b8c8-27d6705443f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:18.508352 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7fc5-4247-4888-b8c8-27d6705443f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:18.508670 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7fc5-4247-4888-b8c8-27d6705443f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:18.510621 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-276e7fc5-4247-4888-b8c8-27d6705443f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:18.620822 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e7fc5-4247-4888-b8c8-27d6705443f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:18.622164 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e7fc5-4247-4888-b8c8-27d6705443f3 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:18.640776 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 583/1164] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:20.892795 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b911c-7c13-48cc-a889-a520e7904795 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:20.893364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b911c-7c13-48cc-a889-a520e7904795 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:20.893364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b911c-7c13-48cc-a889-a520e7904795 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:20.894730 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 582/1165] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:20.900030 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bffd-19d9-4120-a122-82395cc5c2eb None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:20.900458 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bffd-19d9-4120-a122-82395cc5c2eb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:20.900586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bffd-19d9-4120-a122-82395cc5c2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:20.968031 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-3820bffd-19d9-4120-a122-82395cc5c2eb None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:20.969259 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-3820bffd-19d9-4120-a122-82395cc5c2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:21.021444 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:21.064810 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 584/1166] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:21.356040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b911c-7c13-48cc-a889-a520e7904795 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:21.357607 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9a3b911c-7c13-48cc-a889-a520e7904795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:21.393616 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:21.460768 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b911c-7c13-48cc-a889-a520e7904795 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:21.534285 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1638778-3496-4ae3-a30b-035fdae9b65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:21.534889 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1638778-3496-4ae3-a30b-035fdae9b65f service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:21.535164 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1638778-3496-4ae3-a30b-035fdae9b65f service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:21.535430 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1638778-3496-4ae3-a30b-035fdae9b65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:21.537038 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-f1638778-3496-4ae3-a30b-035fdae9b65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:21.617669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:21.647637 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1638778-3496-4ae3-a30b-035fdae9b65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:21.649097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1638778-3496-4ae3-a30b-035fdae9b65f service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:21.666840 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 583/1167] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:23.990979 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c452bc-e61a-4ca0-9497-319e0cbf1b5f None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:23.991539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c452bc-e61a-4ca0-9497-319e0cbf1b5f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:23.991539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c452bc-e61a-4ca0-9497-319e0cbf1b5f None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:23.992934 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 585/1168] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 00:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:31:23.998115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0c00-fa0a-43f3-a64e-10052cd2d6f9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:23.998516 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0c00-fa0a-43f3-a64e-10052cd2d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:23.998660 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0c00-fa0a-43f3-a64e-10052cd2d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:24.065397 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-12ae0c00-fa0a-43f3-a64e-10052cd2d6f9 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:31:24.066610 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-12ae0c00-fa0a-43f3-a64e-10052cd2d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:24.163538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 584/1169] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 00:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:31:24.455078 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c452bc-e61a-4ca0-9497-319e0cbf1b5f None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:31:24.456639 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-68c452bc-e61a-4ca0-9497-319e0cbf1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:24.558876 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c452bc-e61a-4ca0-9497-319e0cbf1b5f None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:31:24.632650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5bd16-537b-4c0c-988d-5b2724069051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:31:24.633272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5bd16-537b-4c0c-988d-5b2724069051 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:31:24.633549 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5bd16-537b-4c0c-988d-5b2724069051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:31:24.633818 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5bd16-537b-4c0c-988d-5b2724069051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:31:24.635388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-11a5bd16-537b-4c0c-988d-5b2724069051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:31:24.643851 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:24.742908 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5bd16-537b-4c0c-988d-5b2724069051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:31:24.744247 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5bd16-537b-4c0c-988d-5b2724069051 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:31:24.761612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 586/1170] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:31:34.161758 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=82 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:31:34.759312 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=50 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:45.553183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:45.553775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:45.553775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:45.633781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:45.634992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:45.730118 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 585/1171] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:45.738218 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85023-6307-49c5-bf81-310326278002 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:45.738707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85023-6307-49c5-bf81-310326278002 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:45.738812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85023-6307-49c5-bf81-310326278002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:45.814411 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ebe85023-6307-49c5-bf81-310326278002 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:45.815530 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ebe85023-6307-49c5-bf81-310326278002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:45.910098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 587/1172] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:45.914972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:45.916229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:45.928335 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac70e1-0014-4006-a322-2bec0e056254 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:45.991952 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:46.025625 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:46.026236 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:46.026517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:46.026792 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:46.027439 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:32:46.027742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:46.028752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:32:46.028752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:32:46.028752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:32:46.029667 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:46.041996 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 586/1173] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 00:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:32:46.052092 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85023-6307-49c5-bf81-310326278002 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:46.061214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85023-6307-49c5-bf81-310326278002 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:46.122035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:46.155694 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:46.156314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:46.156586 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:46.156882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:46.157544 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:46.158628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:32:46.158628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:32:46.158628 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:32:46.159832 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:46.216436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 588/1174] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 00:32:46 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:32:46.220931 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:46.222493 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:46.256000 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd109e57-7253-4158-8708-64278a48b2ce admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:46.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:46.349874 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:46.350155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:46.350429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:46.351060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:46.352092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:32:46.352092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:32:46.352092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:32:46.353316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:46.394780 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 587/1175] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:32:46 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:32:46.398773 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:46.400272 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:46.461869 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b382c-343b-4771-b514-14b59e3fddf2 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:46.544143 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:46.556350 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:46.556486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:46.556684 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:46.556988 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:46.557627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:46.559212 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:46.571486 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 589/1176] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:32:46.575433 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:46.577020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:46.588395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1164e85-9a73-4e38-9c4d-905c56c2c3df admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:46.614858 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:46.683578 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df19b1-17cc-45d2-9437-38500ca08cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:46.684099 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df19b1-17cc-45d2-9437-38500ca08cab admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:46.684376 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df19b1-17cc-45d2-9437-38500ca08cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:46.684652 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df19b1-17cc-45d2-9437-38500ca08cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:46.685325 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df19b1-17cc-45d2-9437-38500ca08cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:46.687067 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df19b1-17cc-45d2-9437-38500ca08cab admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:46.699010 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 588/1177] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:32:46.703640 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:46.705187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:46.738894 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d6f88-89d9-44db-aa78-356a0b82a9e6 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:46.833017 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2b45-1622-48c6-9279-ca44b2841e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:46.833671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2b45-1622-48c6-9279-ca44b2841e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:46.833946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2b45-1622-48c6-9279-ca44b2841e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:46.834215 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2b45-1622-48c6-9279-ca44b2841e3e admin admin] PATH_INFO: `/v3/projects/f72ed1659eb4475694d13c03ceb38a4a/users/763561a9b9a145f9b962a62267b8fcbd/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:46.856972 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2b45-1622-48c6-9279-ca44b2841e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72ed1659eb4475694d13c03ceb38a4a, user_id=763561a9b9a145f9b962a62267b8fcbd, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:46.859710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2b45-1622-48c6-9279-ca44b2841e3e admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:46.883565 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 590/1178] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 00:32:46 2022] PUT /identity/v3/projects/f72ed1659eb4475694d13c03ceb38a4a/users/763561a9b9a145f9b962a62267b8fcbd/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:32:46.895411 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cec4e-4245-46af-b673-0892af0463a6 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:46.895698 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cec4e-4245-46af-b673-0892af0463a6 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:46.895969 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cec4e-4245-46af-b673-0892af0463a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:46.959448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-482cec4e-4245-46af-b673-0892af0463a6 None None] MFA Rules not processed for user `763561a9b9a145f9b962a62267b8fcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:46.960572 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-482cec4e-4245-46af-b673-0892af0463a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:47.037609 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 589/1179] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:32:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:47.050734 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3958-15d1-4e10-a63a-6772b01e262c None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.051046 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3958-15d1-4e10-a63a-6772b01e262c None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.051319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3958-15d1-4e10-a63a-6772b01e262c None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.052651 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 591/1180] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 19 00:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:47.057330 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eedc40-a4f0-4a39-b681-ac1d16e55bb2 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.057613 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eedc40-a4f0-4a39-b681-ac1d16e55bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.057886 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eedc40-a4f0-4a39-b681-ac1d16e55bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.088852 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:47.133402 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-51eedc40-a4f0-4a39-b681-ac1d16e55bb2 None None] MFA Rules not processed for user `0448c6383cd142b68d1962842eeb1623`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:47.134582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-51eedc40-a4f0-4a39-b681-ac1d16e55bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:47.211256 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 590/1181] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 19 00:32:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:47.219502 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb3958-15d1-4e10-a63a-6772b01e262c None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:47.221111 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e2fb3958-15d1-4e10-a63a-6772b01e262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:47.270808 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:47.324594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb3958-15d1-4e10-a63a-6772b01e262c None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:47.398187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0448c6383cd142b68d1962842eeb1623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:47.398793 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.399073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.399345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.400967 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:47.498893 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:47.500322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:47.503826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:47.519004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 592/1182] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:32:47.564164 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1244-2061-4a38-b3e0-0e9fa694fbe1 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.564448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1244-2061-4a38-b3e0-0e9fa694fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.564720 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1244-2061-4a38-b3e0-0e9fa694fbe1 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.565992 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 591/1183] 10.222.0.16 () {52 vars in 830 bytes} [Wed Oct 19 00:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:32:47.569539 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:47.570744 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:47.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ff63a-53d7-419d-b7a4-899eb61ea182 service cinder] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:47.761913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:47.762534 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.762725 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.762991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] PATH_INFO: `/v3/users/763561a9b9a145f9b962a62267b8fcbd` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.776426 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=763561a9b9a145f9b962a62267b8fcbd)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:47.777464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:32:47.777464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:32:47.777464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:32:47.778685 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:47.789181 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:47.845160 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763561a9b9a145f9b962a62267b8fcbd'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:47.858578 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763561a9b9a145f9b962a62267b8fcbd'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:47.884379 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763561a9b9a145f9b962a62267b8fcbd'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:47.884963 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763561a9b9a145f9b962a62267b8fcbd'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:47.894349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763561a9b9a145f9b962a62267b8fcbd'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:47.900977 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 593/1184] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 00:32:47 2022] DELETE /identity/v3/users/763561a9b9a145f9b962a62267b8fcbd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:32:47.905452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:47.905941 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:47.906057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:47.963807 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:32:47.965024 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:48.039147 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:48.052235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 592/1185] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:32:48.062765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:48.063990 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:48.166354 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfade-7ec6-433c-a674-89613193c83c admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:48.222537 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:48.242910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101462-7812-4b7d-8bba-7bd15de82f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:48.243527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101462-7812-4b7d-8bba-7bd15de82f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:48.243809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101462-7812-4b7d-8bba-7bd15de82f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:48.244084 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101462-7812-4b7d-8bba-7bd15de82f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:48.245785 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-b9101462-7812-4b7d-8bba-7bd15de82f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:48.354947 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9101462-7812-4b7d-8bba-7bd15de82f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:48.356279 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9101462-7812-4b7d-8bba-7bd15de82f2d service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:48.374199 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 594/1186] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:32:48.729483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:32:48.730723 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:32:48.742821 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebfcb7-bd85-420d-a52d-972c16e342ee None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:32:48.843334 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:32:48.844041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:32:48.844329 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:32:48.844596 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] PATH_INFO: `/v3/projects/f72ed1659eb4475694d13c03ceb38a4a` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:32:48.854404 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72ed1659eb4475694d13c03ceb38a4a)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:32:48.855425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:32:48.855425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:32:48.855425 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:32:48.856611 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:32:48.916042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72ed1659eb4475694d13c03ceb38a4a', 'request_id': 'req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:48.922364 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72ed1659eb4475694d13c03ceb38a4a', 'request_id': 'req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:48.933883 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72ed1659eb4475694d13c03ceb38a4a', 'request_id': 'req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:48.964526 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] The token cache is being invalidate because project f72ed1659eb4475694d13c03ceb38a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81477) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:32:48.964815 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:48.965269 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-ee9466fa-d9d8-4002-8e4d-9821e89a7da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:32:48.966676 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 593/1187] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 00:32:48 2022] DELETE /identity/v3/projects/f72ed1659eb4475694d13c03ceb38a4a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:32:58.371931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=62 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:58.962469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:00.470213 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7cc7-24c1-4547-bda8-b1a8b8f3ace3 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:00.470925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7cc7-24c1-4547-bda8-b1a8b8f3ace3 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:00.470925 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7cc7-24c1-4547-bda8-b1a8b8f3ace3 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:00.472262 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 595/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:00.477648 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1c4e-2f31-4692-a978-69de8e3dd326 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:00.478112 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1c4e-2f31-4692-a978-69de8e3dd326 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:00.478218 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1c4e-2f31-4692-a978-69de8e3dd326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:00.556918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-a8ba1c4e-2f31-4692-a978-69de8e3dd326 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:00.558123 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-a8ba1c4e-2f31-4692-a978-69de8e3dd326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:00.662665 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 594/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:00.815226 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d7cc7-24c1-4547-bda8-b1a8b8f3ace3 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:00.817365 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-dc2d7cc7-24c1-4547-bda8-b1a8b8f3ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:00.934271 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d7cc7-24c1-4547-bda8-b1a8b8f3ace3 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:00.940668 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b1bf-539e-4fd9-bcf1-09bd7eae57f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:00.941305 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b1bf-539e-4fd9-bcf1-09bd7eae57f1 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:00.941588 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b1bf-539e-4fd9-bcf1-09bd7eae57f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:00.941862 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b1bf-539e-4fd9-bcf1-09bd7eae57f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:00.950059 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b1bf-539e-4fd9-bcf1-09bd7eae57f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:00.951892 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b1bf-539e-4fd9-bcf1-09bd7eae57f1 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:00.961214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 596/1190] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:02.044071 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47334-9b46-4853-824e-8d7490479549 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:02.044646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47334-9b46-4853-824e-8d7490479549 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:02.044646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47334-9b46-4853-824e-8d7490479549 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:02.045991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 595/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:02.052259 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda5711-d8c1-460c-9ec1-c5f3eef4fb0a None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:02.052687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda5711-d8c1-460c-9ec1-c5f3eef4fb0a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:02.052791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda5711-d8c1-460c-9ec1-c5f3eef4fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:02.073413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ecda5711-d8c1-460c-9ec1-c5f3eef4fb0a None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:02.074588 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ecda5711-d8c1-460c-9ec1-c5f3eef4fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:02.083524 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 597/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:02.235478 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47334-9b46-4853-824e-8d7490479549 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:02.250180 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47334-9b46-4853-824e-8d7490479549 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:02.255636 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae811e00-7479-4d74-a342-ab9d2e870c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:02.256229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811e00-7479-4d74-a342-ab9d2e870c62 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:02.256509 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811e00-7479-4d74-a342-ab9d2e870c62 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:02.256780 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811e00-7479-4d74-a342-ab9d2e870c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:02.264722 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae811e00-7479-4d74-a342-ab9d2e870c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:02.266315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae811e00-7479-4d74-a342-ab9d2e870c62 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:02.276015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 596/1193] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:04.829381 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731226-086f-4dee-a2d4-13445d77a8d4 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:04.830001 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731226-086f-4dee-a2d4-13445d77a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:04.830151 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731226-086f-4dee-a2d4-13445d77a8d4 None None] PATH_INFO: `/v3` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:04.831419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 598/1194] 10.222.0.23 () {54 vars in 925 bytes} [Wed Oct 19 00:34:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:34:04.844686 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddda0f-a9aa-4054-a713-2706308f4985 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:04.845295 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddda0f-a9aa-4054-a713-2706308f4985 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:04.845410 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddda0f-a9aa-4054-a713-2706308f4985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:04.904697 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-d8ddda0f-a9aa-4054-a713-2706308f4985 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:04.905926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d8ddda0f-a9aa-4054-a713-2706308f4985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:04.923140 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:04.979801 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 597/1195] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Oct 19 00:34:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:12.068670 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=56 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:13.478092 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aba29-0d81-48c3-a568-bb0968eb67a5 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:13.478780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aba29-0d81-48c3-a568-bb0968eb67a5 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:13.478780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aba29-0d81-48c3-a568-bb0968eb67a5 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:13.480047 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 599/1196] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 00:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:13.485350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecef760-b7e3-4215-b661-a197ea7caed9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:13.486454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecef760-b7e3-4215-b661-a197ea7caed9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:13.486575 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecef760-b7e3-4215-b661-a197ea7caed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:13.506146 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-5ecef760-b7e3-4215-b661-a197ea7caed9 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:13.507343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-5ecef760-b7e3-4215-b661-a197ea7caed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:13.515999 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 598/1197] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 00:34:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:13.524037 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aba29-0d81-48c3-a568-bb0968eb67a5 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:13.538280 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aba29-0d81-48c3-a568-bb0968eb67a5 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:13.543408 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b6c32-50cd-45ee-88b5-4708013f8701 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:13.544004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6c32-50cd-45ee-88b5-4708013f8701 service placement] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:13.544284 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6c32-50cd-45ee-88b5-4708013f8701 service placement] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:13.544560 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6c32-50cd-45ee-88b5-4708013f8701 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:13.552805 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b6c32-50cd-45ee-88b5-4708013f8701 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:13.554414 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b6c32-50cd-45ee-88b5-4708013f8701 service placement] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:13.564037 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 600/1198] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:13.748727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c4650-42a5-4490-a884-17110652ef7c None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:13.749035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c4650-42a5-4490-a884-17110652ef7c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:13.749327 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c4650-42a5-4490-a884-17110652ef7c None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:13.750674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 599/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:13.756765 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594188f0-d24a-4388-b968-2ec55b1f1bc7 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:13.757084 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594188f0-d24a-4388-b968-2ec55b1f1bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:13.757376 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594188f0-d24a-4388-b968-2ec55b1f1bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:13.777342 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-594188f0-d24a-4388-b968-2ec55b1f1bc7 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:13.778525 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-594188f0-d24a-4388-b968-2ec55b1f1bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:13.787003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 601/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:13.938190 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c4650-42a5-4490-a884-17110652ef7c None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:13.955163 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c4650-42a5-4490-a884-17110652ef7c None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:13.961676 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c945081-c97f-44e9-8770-fb78fb87e18d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:13.962396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945081-c97f-44e9-8770-fb78fb87e18d service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:13.962672 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945081-c97f-44e9-8770-fb78fb87e18d service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:13.963068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945081-c97f-44e9-8770-fb78fb87e18d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:13.972350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c945081-c97f-44e9-8770-fb78fb87e18d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:13.973942 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c945081-c97f-44e9-8770-fb78fb87e18d service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:13.983220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 600/1201] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:15.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fbc11-6dde-4e49-ac1a-b859fb00a420 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:15.060862 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fbc11-6dde-4e49-ac1a-b859fb00a420 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:15.060862 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fbc11-6dde-4e49-ac1a-b859fb00a420 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:15.062189 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 602/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 00:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:15.068632 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600123-64a1-45df-a09e-0b00c7c337be None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:15.069115 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600123-64a1-45df-a09e-0b00c7c337be None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:15.069229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600123-64a1-45df-a09e-0b00c7c337be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:15.088853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-9a600123-64a1-45df-a09e-0b00c7c337be None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:15.090042 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9a600123-64a1-45df-a09e-0b00c7c337be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:15.098905 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 601/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 00:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:15.250543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fbc11-6dde-4e49-ac1a-b859fb00a420 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:15.264331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fbc11-6dde-4e49-ac1a-b859fb00a420 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:15.270184 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8bc04-ac12-4904-bf50-bb721265af68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:15.270767 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8bc04-ac12-4904-bf50-bb721265af68 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:15.271045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8bc04-ac12-4904-bf50-bb721265af68 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:15.271314 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8bc04-ac12-4904-bf50-bb721265af68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:15.279125 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8bc04-ac12-4904-bf50-bb721265af68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:15.280688 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8bc04-ac12-4904-bf50-bb721265af68 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:15.290610 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 603/1204] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:34:19.225497 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54378-2459-45f1-939d-fe6e5129e47a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:19.226027 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54378-2459-45f1-939d-fe6e5129e47a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:19.226027 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54378-2459-45f1-939d-fe6e5129e47a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:19.227336 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 602/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:19.232756 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f0f4-3cb9-4c0f-9a3a-5094e78307d1 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:19.233229 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f0f4-3cb9-4c0f-9a3a-5094e78307d1 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:19.233335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f0f4-3cb9-4c0f-9a3a-5094e78307d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:19.252624 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-e5f8f0f4-3cb9-4c0f-9a3a-5094e78307d1 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:19.253833 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-e5f8f0f4-3cb9-4c0f-9a3a-5094e78307d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:19.261391 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 604/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:19.549991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54378-2459-45f1-939d-fe6e5129e47a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:19.551678 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-38a54378-2459-45f1-939d-fe6e5129e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:19.628338 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54378-2459-45f1-939d-fe6e5129e47a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:19.631884 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdca851-d6da-47c3-a5fc-1cef664b0651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:19.632484 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca851-d6da-47c3-a5fc-1cef664b0651 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:19.632759 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca851-d6da-47c3-a5fc-1cef664b0651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:19.633053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca851-d6da-47c3-a5fc-1cef664b0651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:19.643136 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdca851-d6da-47c3-a5fc-1cef664b0651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:19.644640 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdca851-d6da-47c3-a5fc-1cef664b0651 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:19.654075 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 603/1207] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:21.817142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90aade-3059-42c2-85ad-374e940f52dc None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:21.817723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90aade-3059-42c2-85ad-374e940f52dc None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:21.817723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90aade-3059-42c2-85ad-374e940f52dc None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:21.819035 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 605/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:21.824306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd4dc8-ef9e-45b1-8de7-f742f902d656 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:21.824713 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd4dc8-ef9e-45b1-8de7-f742f902d656 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:21.824894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd4dc8-ef9e-45b1-8de7-f742f902d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:21.844952 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-cfdd4dc8-ef9e-45b1-8de7-f742f902d656 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:21.847238 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-cfdd4dc8-ef9e-45b1-8de7-f742f902d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:21.854998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 604/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:22.151224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90aade-3059-42c2-85ad-374e940f52dc None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:22.162020 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90aade-3059-42c2-85ad-374e940f52dc None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:22.165869 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58886a5-5586-4944-b8bd-c8322e6df44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:22.166459 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58886a5-5586-4944-b8bd-c8322e6df44c service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:22.166740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58886a5-5586-4944-b8bd-c8322e6df44c service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:22.167018 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58886a5-5586-4944-b8bd-c8322e6df44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:22.175647 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58886a5-5586-4944-b8bd-c8322e6df44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:22.177073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58886a5-5586-4944-b8bd-c8322e6df44c service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:22.186223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 606/1210] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:25.881445 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059f96-a610-4ff0-a81f-8bb6524c1e19 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:25.882051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059f96-a610-4ff0-a81f-8bb6524c1e19 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:25.882051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059f96-a610-4ff0-a81f-8bb6524c1e19 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:25.883324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 605/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:25.888523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda8d35-4a7e-4ac1-9f8c-421b3c6d8be5 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:25.888971 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda8d35-4a7e-4ac1-9f8c-421b3c6d8be5 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:25.889106 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda8d35-4a7e-4ac1-9f8c-421b3c6d8be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:25.908820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-beda8d35-4a7e-4ac1-9f8c-421b3c6d8be5 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:25.910214 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-beda8d35-4a7e-4ac1-9f8c-421b3c6d8be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:25.918085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 607/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:26.221316 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059f96-a610-4ff0-a81f-8bb6524c1e19 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:26.222957 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b0059f96-a610-4ff0-a81f-8bb6524c1e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:26.287298 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=100 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:26.300742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059f96-a610-4ff0-a81f-8bb6524c1e19 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:26.304259 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71505-4f7e-4648-98e1-283fab29a4c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0448c6383cd142b68d1962842eeb1623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:26.304877 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71505-4f7e-4648-98e1-283fab29a4c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:26.305155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71505-4f7e-4648-98e1-283fab29a4c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:26.305423 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71505-4f7e-4648-98e1-283fab29a4c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:26.314253 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc71505-4f7e-4648-98e1-283fab29a4c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:26.315727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc71505-4f7e-4648-98e1-283fab29a4c3 service cinder] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:26.325183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 606/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:28.476248 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e42df-c146-4430-bc1c-2d663c49ea22 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:28.476813 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e42df-c146-4430-bc1c-2d663c49ea22 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:28.476813 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e42df-c146-4430-bc1c-2d663c49ea22 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:28.478169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 608/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 00:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:34:28.483595 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fdfae-4e76-4539-957d-ff022141b03b None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:28.484008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fdfae-4e76-4539-957d-ff022141b03b None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:28.484162 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fdfae-4e76-4539-957d-ff022141b03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:28.504045 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-732fdfae-4e76-4539-957d-ff022141b03b None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:34:28.505256 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-732fdfae-4e76-4539-957d-ff022141b03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:28.512911 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 607/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 00:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:34:28.821757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e42df-c146-4430-bc1c-2d663c49ea22 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:34:28.823506 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-974e42df-c146-4430-bc1c-2d663c49ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:34:28.836514 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e42df-c146-4430-bc1c-2d663c49ea22 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:34:28.839954 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20807da-e21c-4027-b469-7acd87e31871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0448c6383cd142b68d1962842eeb1623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:34:28.840540 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20807da-e21c-4027-b469-7acd87e31871 service cinder] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:34:28.840820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20807da-e21c-4027-b469-7acd87e31871 service cinder] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:34:28.841122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20807da-e21c-4027-b469-7acd87e31871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:34:28.849611 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20807da-e21c-4027-b469-7acd87e31871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:34:28.851022 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20807da-e21c-4027-b469-7acd87e31871 service cinder] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:34:28.860162 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 609/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:34:38.499288 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=11 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:38.856065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=33 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:46.564483 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8fd4-81b7-4c25-92ba-97eaa5e01459 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.565132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8fd4-81b7-4c25-92ba-97eaa5e01459 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.565132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8fd4-81b7-4c25-92ba-97eaa5e01459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.583405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23158056-0799-4e51-87eb-039f5e2e1035 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.583946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23158056-0799-4e51-87eb-039f5e2e1035 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.583946 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23158056-0799-4e51-87eb-039f5e2e1035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.585281 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-e8ed8fd4-81b7-4c25-92ba-97eaa5e01459 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:46.586482 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e8ed8fd4-81b7-4c25-92ba-97eaa5e01459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:46.595013 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 608/1217] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:46.603983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f625ac4-e733-41aa-8873-b8594a38d9eb None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.604150 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-23158056-0799-4e51-87eb-039f5e2e1035 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:46.604263 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f625ac4-e733-41aa-8873-b8594a38d9eb None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.604534 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f625ac4-e733-41aa-8873-b8594a38d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.605297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-23158056-0799-4e51-87eb-039f5e2e1035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:46.613382 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 610/1218] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:46.622101 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21849e73-6aef-455d-8bcf-98f14d3d4f42 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.622385 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21849e73-6aef-455d-8bcf-98f14d3d4f42 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.622659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21849e73-6aef-455d-8bcf-98f14d3d4f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.623729 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-6f625ac4-e733-41aa-8873-b8594a38d9eb None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:46.624960 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-6f625ac4-e733-41aa-8873-b8594a38d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:46.632785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 609/1219] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:46.637322 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f625ac4-e733-41aa-8873-b8594a38d9eb None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.642112 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-21849e73-6aef-455d-8bcf-98f14d3d4f42 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:46.643357 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-21849e73-6aef-455d-8bcf-98f14d3d4f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:46.647719 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f625ac4-e733-41aa-8873-b8594a38d9eb None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.652626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.653257 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.653571 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.653819 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.654703 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81477) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:35:46.654827 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 611/1220] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:46.654920 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.655981 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21849e73-6aef-455d-8bcf-98f14d3d4f42 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.657141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.664940 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21849e73-6aef-455d-8bcf-98f14d3d4f42 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 610/1221] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 00:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 00:35:46.669926 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.670484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.670761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.671096 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] PATH_INFO: `/v3/domains` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.671867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81478) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 00:35:46.672169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.673195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:46.673195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:35:46.673195 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:35:46.674065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.677689 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.685852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 612/1222] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 00:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 00:35:46.687321 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b504422-2c93-4d51-99d1-d5c56e9371fc admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.691953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.692548 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.693046 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.693178 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.693753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.693878 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.694765 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:46.694765 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:35:46.694765 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:35:46.695950 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.704761 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fff2dc-69ef-4dc6-a2ab-02c5078f8444 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.710643 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.711269 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.711546 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.711993 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.712625 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.714559 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.735500 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 611/1223] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:35:46.739932 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.744135 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 613/1224] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:35:46.748388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.805708 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbad6b-2f4e-4761-9fe9-daa1b0a7e50a admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.810910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f7c8b-c08e-4bdf-913e-9946559540e3 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.812561 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.813197 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.813476 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.813742 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.814362 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.815874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.816268 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.816413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.816691 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.817013 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.817632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.818650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:35:46.818650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:35:46.818650 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:35:46.819835 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.839790 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 612/1225] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:35:46.842620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 614/1226] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:35:46.844550 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.847374 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.854313 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a70d-4a94-4073-84bb-58f4c612137e admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.856981 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfea87-e882-4a01-a263-00c7ae0c8959 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.860947 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.861548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.862058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.862170 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.862405 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.862522 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.862680 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.862782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.863316 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.864972 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.865102 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.866586 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.875622 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 615/1227] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:46.877112 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 613/1228] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:46.879767 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.880593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.890326 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e200-1449-4df3-a1a8-dc686de5d0e9 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.890614 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4055-662c-4c9a-b23d-159c87d3a329 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.895195 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.895600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.895773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.896051 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.896169 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.896324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.896435 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.896710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.897008 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.897364 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.898566 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.898907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.908861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 614/1229] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:35:46.912496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 616/1230] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 00:35:46.912995 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.913484 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:46.922552 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e98d-18c4-4ac0-a450-1a7f273ebe25 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.923361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8768d7-5977-4434-9bb2-0fa7f9276c6a admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:46.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be71c6-3b40-48f4-aa89-9f926ae074ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.931283 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be71c6-3b40-48f4-aa89-9f926ae074ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.931403 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1b256-52dd-46f9-975f-d627d529e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:46.931517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be71c6-3b40-48f4-aa89-9f926ae074ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.931517 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be71c6-3b40-48f4-aa89-9f926ae074ba admin admin] PATH_INFO: `/v3/projects/9b82317133cc48ab839c482b143e1ac5/users/0151a37ca51c41658110c29c3f73ac69/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.931671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b256-52dd-46f9-975f-d627d529e9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.931671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b256-52dd-46f9-975f-d627d529e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.931671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b256-52dd-46f9-975f-d627d529e9e9 admin admin] PATH_INFO: `/v3/projects/ac4a5a4ed48b4b77ba8a139620596b48/users/6908a293f30a4b229198d4990df9158c/roles/c1be01f06d6d4babaadc2a4809ef9dfc` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.945756 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1b256-52dd-46f9-975f-d627d529e9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4a5a4ed48b4b77ba8a139620596b48, user_id=6908a293f30a4b229198d4990df9158c, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.948411 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1b256-52dd-46f9-975f-d627d529e9e9 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.958682 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be71c6-3b40-48f4-aa89-9f926ae074ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b82317133cc48ab839c482b143e1ac5, user_id=0151a37ca51c41658110c29c3f73ac69, role_id=c1be01f06d6d4babaadc2a4809ef9dfc)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:46.961383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be71c6-3b40-48f4-aa89-9f926ae074ba admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:46.962769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 617/1231] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 00:35:46 2022] PUT /identity/v3/projects/ac4a5a4ed48b4b77ba8a139620596b48/users/6908a293f30a4b229198d4990df9158c/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:35:46.968417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cf524-6614-4e43-8d51-ccc988a393a6 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.968774 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cf524-6614-4e43-8d51-ccc988a393a6 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.969096 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cf524-6614-4e43-8d51-ccc988a393a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.975618 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 615/1232] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 00:35:46 2022] PUT /identity/v3/projects/9b82317133cc48ab839c482b143e1ac5/users/0151a37ca51c41658110c29c3f73ac69/roles/c1be01f06d6d4babaadc2a4809ef9dfc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:35:46.980486 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:46.980781 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:46.981105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:46.987730 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-962cf524-6614-4e43-8d51-ccc988a393a6 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:46.988951 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-962cf524-6614-4e43-8d51-ccc988a393a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:47.000458 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] MFA Rules not processed for user `c0df48403b70414cb5833ddb3f121bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:47.001691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:47.037273 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:47.042747 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:47.053085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 618/1233] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:47.060984 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 616/1234] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:35:47.065744 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cf524-6614-4e43-8d51-ccc988a393a6 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:47.072086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:47.073657 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:47.121693 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cf524-6614-4e43-8d51-ccc988a393a6 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:47.125901 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eb563-834b-4e94-b87b-51da0ea2a059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:47.126520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb563-834b-4e94-b87b-51da0ea2a059 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:47.126803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb563-834b-4e94-b87b-51da0ea2a059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:47.127079 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb563-834b-4e94-b87b-51da0ea2a059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:47.130816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c54201-2c33-48d4-8a8d-a3e39c6a13a0 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:47.135062 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:47.135833 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:47.136073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eb563-834b-4e94-b87b-51da0ea2a059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:47.136181 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:47.136368 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:47.137582 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540eb563-834b-4e94-b87b-51da0ea2a059 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:47.145760 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:47.147155 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:47.147758 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 619/1235] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:35:47.156553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 617/1236] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:35:52.089622 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614abe26-6b57-430d-a7ba-b2995bc3e0a9 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.090527 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614abe26-6b57-430d-a7ba-b2995bc3e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.090958 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614abe26-6b57-430d-a7ba-b2995bc3e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.145840 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-614abe26-6b57-430d-a7ba-b2995bc3e0a9 None None] MFA Rules not processed for user `0151a37ca51c41658110c29c3f73ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:52.147322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-614abe26-6b57-430d-a7ba-b2995bc3e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:52.269780 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 620/1237] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:52.274473 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:52.285366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b87e-ec3f-462d-8b64-63ba4e211e33 service neutron] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.291303 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.292105 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.292498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.292924 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.295541 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.296119 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.340346 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 618/1238] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 00:35:52 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:35:52.341384 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614abe26-6b57-430d-a7ba-b2995bc3e0a9 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:52.355341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614abe26-6b57-430d-a7ba-b2995bc3e0a9 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.455028 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.456574 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.457086 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.458308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.459205 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.461880 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.495345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 621/1239] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:35:52 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:35:52.499578 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:52.512415 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a6f4e-f837-4f4f-9841-a7fa5dc2bf27 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.519950 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.520564 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.520953 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.521226 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.521883 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.525259 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.541731 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 619/1240] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:52.546979 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:52.557523 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4dc3-c6e3-462d-967a-f4f45ca37ea5 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.563841 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.564640 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.565115 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.565547 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] PATH_INFO: `/v3/projects/2cf2937999b844ed9d31209243ca1f6f/users/2fb476f28ada4cba941995bcca3271a8/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.600600 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf2937999b844ed9d31209243ca1f6f, user_id=2fb476f28ada4cba941995bcca3271a8, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.603804 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.606869 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:52.628635 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 622/1241] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 00:35:52 2022] PUT /identity/v3/projects/2cf2937999b844ed9d31209243ca1f6f/users/2fb476f28ada4cba941995bcca3271a8/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:35:52.632307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:52.646098 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da61f02-56d0-4a29-8874-b0005eb44431 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.713077 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bb64d-9850-4344-bbfa-cdd38a0bd9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.713798 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb64d-9850-4344-bbfa-cdd38a0bd9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.714144 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb64d-9850-4344-bbfa-cdd38a0bd9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.714879 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb64d-9850-4344-bbfa-cdd38a0bd9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.715372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bb64d-9850-4344-bbfa-cdd38a0bd9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.716956 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bb64d-9850-4344-bbfa-cdd38a0bd9a6 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.729738 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 620/1242] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:52.733975 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:52.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b49a1-a2ff-4159-b75b-5e608f682274 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:52.753739 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:52.754451 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.754733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.755012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] PATH_INFO: `/v3/projects/2cf2937999b844ed9d31209243ca1f6f/users/2fb476f28ada4cba941995bcca3271a8/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.758814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf2937999b844ed9d31209243ca1f6f, user_id=2fb476f28ada4cba941995bcca3271a8, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:52.761598 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:52.775579 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 623/1243] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 00:35:52 2022] PUT /identity/v3/projects/2cf2937999b844ed9d31209243ca1f6f/users/2fb476f28ada4cba941995bcca3271a8/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 00:35:52.831935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6807d-45df-4787-92d4-df1c11774486 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:52.832295 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6807d-45df-4787-92d4-df1c11774486 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:52.832641 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6807d-45df-4787-92d4-df1c11774486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:52.868169 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-17b6807d-45df-4787-92d4-df1c11774486 None None] MFA Rules not processed for user `6908a293f30a4b229198d4990df9158c`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:52.869712 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-17b6807d-45df-4787-92d4-df1c11774486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:52.920383 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:52.960993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 621/1244] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:52.965932 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:53.057128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15fcb7-dda7-42a7-a0c5-84fcadce7c22 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:53.063224 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:53.063922 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:53.064219 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:53.064871 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:53.065529 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:53.067842 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:53.118151 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 624/1245] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 00:35:52 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 00:35:53.121358 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6807d-45df-4787-92d4-df1c11774486 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:53.134820 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6807d-45df-4787-92d4-df1c11774486 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:53.215617 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:53.216086 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:53.216369 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:53.216678 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] PATH_INFO: `/v3/users` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:53.217353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:53.220035 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:53.252964 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 622/1246] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 00:35:53 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 00:35:53.254335 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:53.265446 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e728-41b2-4cbe-9e3d-a9f51de9b6f9 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:53.272637 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:53.273292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:53.273571 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:53.273844 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:53.275012 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:53.277257 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:53.295141 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 625/1247] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:53.296643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:53.307272 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a392-9f0f-450e-800e-705af4ea7160 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:53.312376 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:53.313152 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:53.313419 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:53.313691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] PATH_INFO: `/v3/projects/87794bd0bbc54a4d8bf7378605f19a9f/users/5fb6606116514e509853c93957e8e2ee/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:53.332522 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] RBAC: Authorizing `identity:create_grant(project_id=87794bd0bbc54a4d8bf7378605f19a9f, user_id=5fb6606116514e509853c93957e8e2ee, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:53.335809 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:53.362050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 623/1248] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 00:35:53 2022] PUT /identity/v3/projects/87794bd0bbc54a4d8bf7378605f19a9f/users/5fb6606116514e509853c93957e8e2ee/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:35:53.363865 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:53.388508 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06008-fbcd-42a0-908f-02bf546371a5 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:53.566828 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b50baf-36fb-4d8d-890e-8d7100eb190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:53.567465 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50baf-36fb-4d8d-890e-8d7100eb190b admin admin] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:53.567749 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50baf-36fb-4d8d-890e-8d7100eb190b admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:53.568026 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50baf-36fb-4d8d-890e-8d7100eb190b admin admin] PATH_INFO: `/v3/roles` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:53.568686 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b50baf-36fb-4d8d-890e-8d7100eb190b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:53.570543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b50baf-36fb-4d8d-890e-8d7100eb190b admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:53.588886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 626/1249] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 00:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 00:35:53.592360 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:53.609257 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb435-de3e-4b84-8475-a7aae24228df admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:53.617926 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:53.618692 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:53.619254 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:53.619972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] PATH_INFO: `/v3/projects/87794bd0bbc54a4d8bf7378605f19a9f/users/5fb6606116514e509853c93957e8e2ee/roles/08d7ebb3d6044305874059d45f17c926` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:53.622805 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87794bd0bbc54a4d8bf7378605f19a9f, user_id=5fb6606116514e509853c93957e8e2ee, role_id=08d7ebb3d6044305874059d45f17c926)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:53.627309 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:53.653692 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 624/1250] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 00:35:53 2022] PUT /identity/v3/projects/87794bd0bbc54a4d8bf7378605f19a9f/users/5fb6606116514e509853c93957e8e2ee/roles/08d7ebb3d6044305874059d45f17c926 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:35:59.102161 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9640f-a702-41cc-9e53-74e2c3174b1d None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:59.102671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9640f-a702-41cc-9e53-74e2c3174b1d None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:59.102862 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9640f-a702-41cc-9e53-74e2c3174b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:59.154258 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-76a9640f-a702-41cc-9e53-74e2c3174b1d None None] MFA Rules not processed for user `2fb476f28ada4cba941995bcca3271a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:35:59.156788 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-76a9640f-a702-41cc-9e53-74e2c3174b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:59.213725 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:59.270572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 627/1251] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:35:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:35:59.287134 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:35:59.289306 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:35:59.461755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896027cd-edb1-41a6-96bb-0df26aacf4c8 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:35:59.471612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21e611c23e574338821093a7cd4a26be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:35:59.472124 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:35:59.472412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:35:59.472688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:35:59.518833 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:59.560635 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:35:59.563119 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:35:59.584796 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 625/1252] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:35:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:00.093007 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3039-455f-4fed-ac9a-d0a820d449ed None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:00.093298 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3039-455f-4fed-ac9a-d0a820d449ed None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:00.093646 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3039-455f-4fed-ac9a-d0a820d449ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:00.127631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-09bb3039-455f-4fed-ac9a-d0a820d449ed None None] MFA Rules not processed for user `5fb6606116514e509853c93957e8e2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:00.128852 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-09bb3039-455f-4fed-ac9a-d0a820d449ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:00.224130 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 628/1253] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:00.242904 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:00.244666 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:00.257009 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef58d2-4a9b-486f-ad77-54412deaf44b service glance] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:00.276336 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21e611c23e574338821093a7cd4a26be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:00.277379 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:00.277763 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:00.278153 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:00.371020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:00.385453 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:00.418552 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 626/1254] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:00.575468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b57a-82df-47d8-bb37-f6c6478c68b9 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:00.575769 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b57a-82df-47d8-bb37-f6c6478c68b9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:00.576049 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b57a-82df-47d8-bb37-f6c6478c68b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:00.641460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-9497b57a-82df-47d8-bb37-f6c6478c68b9 None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:00.642740 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-9497b57a-82df-47d8-bb37-f6c6478c68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:00.714768 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 629/1255] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:00.796812 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:00.798281 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:00.909097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0a499-3822-41fa-a6c7-6894a83c57ac service glance] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:00.916642 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:00.917504 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:00.917782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:00.918054 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:00.928068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:00.930432 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:00.940496 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 627/1256] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:36:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:36:01.072322 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271332-40f7-4d63-8da2-96a8e42a0c5b None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:01.072611 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271332-40f7-4d63-8da2-96a8e42a0c5b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:01.072935 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271332-40f7-4d63-8da2-96a8e42a0c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:01.098372 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-48271332-40f7-4d63-8da2-96a8e42a0c5b None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:01.099910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-48271332-40f7-4d63-8da2-96a8e42a0c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:01.113275 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 630/1257] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:36:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:01.145384 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:01.160324 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3c413-3fae-4d66-8790-ab5c0363e7c0 service swift] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:01.167229 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c27a50-f5ee-4f4e-8285-1da21befb301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:01.167853 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c27a50-f5ee-4f4e-8285-1da21befb301 service swift] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:01.168128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c27a50-f5ee-4f4e-8285-1da21befb301 service swift] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:01.168398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c27a50-f5ee-4f4e-8285-1da21befb301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:01.179126 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c27a50-f5ee-4f4e-8285-1da21befb301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:01.182267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c27a50-f5ee-4f4e-8285-1da21befb301 service swift] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:01.193031 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 628/1258] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:36:11.026697 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557f7a9-c8a5-4154-b53a-37f2fbb2518c None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:11.027371 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557f7a9-c8a5-4154-b53a-37f2fbb2518c None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:11.027371 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557f7a9-c8a5-4154-b53a-37f2fbb2518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:11.047496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-f557f7a9-c8a5-4154-b53a-37f2fbb2518c None None] MFA Rules not processed for user `6908a293f30a4b229198d4990df9158c`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:11.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-f557f7a9-c8a5-4154-b53a-37f2fbb2518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:11.057006 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 631/1259] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:11.188779 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=89 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:11.362454 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449012-d7f4-4b28-a188-dba82509255f None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:11.364110 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449012-d7f4-4b28-a188-dba82509255f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:11.365036 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449012-d7f4-4b28-a188-dba82509255f None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:11.368111 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 629/1260] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 00:36:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:11.373868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79827211-c57a-4f98-80f9-1384f89dd6a8 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:11.374105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79827211-c57a-4f98-80f9-1384f89dd6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:11.374391 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79827211-c57a-4f98-80f9-1384f89dd6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:11.417938 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=100 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:11.422378 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-79827211-c57a-4f98-80f9-1384f89dd6a8 None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:11.424397 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-79827211-c57a-4f98-80f9-1384f89dd6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:11.530626 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 632/1261] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:11.531849 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211451-ac5a-4427-b6f1-b7bee95b0def None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:11.532137 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211451-ac5a-4427-b6f1-b7bee95b0def None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:11.532412 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211451-ac5a-4427-b6f1-b7bee95b0def None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:11.533785 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 630/1262] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 19 00:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:36:11.539594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730b2a1-9c4f-4ee8-b6ec-ef55afc5eaee None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:11.540137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730b2a1-9c4f-4ee8-b6ec-ef55afc5eaee None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:11.540422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730b2a1-9c4f-4ee8-b6ec-ef55afc5eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:11.563950 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-b730b2a1-9c4f-4ee8-b6ec-ef55afc5eaee None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:11.565212 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-b730b2a1-9c4f-4ee8-b6ec-ef55afc5eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:11.575928 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 633/1263] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:11.589313 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211451-ac5a-4427-b6f1-b7bee95b0def None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:11.601583 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211451-ac5a-4427-b6f1-b7bee95b0def None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:11.605708 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad41134-46a4-48ba-bb9e-0dc832d3dc7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21e611c23e574338821093a7cd4a26be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:11.606396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad41134-46a4-48ba-bb9e-0dc832d3dc7a service glance] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:11.606882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad41134-46a4-48ba-bb9e-0dc832d3dc7a service glance] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:11.607372 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad41134-46a4-48ba-bb9e-0dc832d3dc7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:11.622268 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad41134-46a4-48ba-bb9e-0dc832d3dc7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:11.625702 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad41134-46a4-48ba-bb9e-0dc832d3dc7a service glance] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:11.640896 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 631/1264] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:12.011851 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f3415-e7cc-4ca5-bb0e-716d2840e95b None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.012139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f3415-e7cc-4ca5-bb0e-716d2840e95b None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.012415 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f3415-e7cc-4ca5-bb0e-716d2840e95b None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.014621 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 634/1265] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 19 00:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:12.020020 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9eaad-1837-4ada-b225-f51094f98c79 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.020308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9eaad-1837-4ada-b225-f51094f98c79 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.020585 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9eaad-1837-4ada-b225-f51094f98c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.063195 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-aab9eaad-1837-4ada-b225-f51094f98c79 None None] MFA Rules not processed for user `eb62183c29e74f75a580306cf6cfae56`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:12.064594 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-aab9eaad-1837-4ada-b225-f51094f98c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:12.122015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 632/1266] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:12.133496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f3415-e7cc-4ca5-bb0e-716d2840e95b None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:12.146412 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f3415-e7cc-4ca5-bb0e-716d2840e95b None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:12.150388 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772151ae-ffb8-438e-94be-56ad00ed8433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:12.151437 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772151ae-ffb8-438e-94be-56ad00ed8433 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.151788 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772151ae-ffb8-438e-94be-56ad00ed8433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.152132 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772151ae-ffb8-438e-94be-56ad00ed8433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.161777 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772151ae-ffb8-438e-94be-56ad00ed8433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:12.163510 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772151ae-ffb8-438e-94be-56ad00ed8433 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:12.177413 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 635/1267] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:12.719100 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474058e-4a4a-4b21-97b6-f503b6b68a53 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.719620 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474058e-4a4a-4b21-97b6-f503b6b68a53 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.719727 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474058e-4a4a-4b21-97b6-f503b6b68a53 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.721149 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 633/1268] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 00:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:36:12.727404 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f176e-76b7-4995-a1a1-8cc85a10a2e9 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.727688 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f176e-76b7-4995-a1a1-8cc85a10a2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.727958 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f176e-76b7-4995-a1a1-8cc85a10a2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.747686 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474058e-4a4a-4b21-97b6-f503b6b68a53 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:12.749879 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-944f176e-76b7-4995-a1a1-8cc85a10a2e9 None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:12.751146 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-944f176e-76b7-4995-a1a1-8cc85a10a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:12.760638 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 636/1269] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:12.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f6b65-98ee-4870-b9d3-fbd3c4e2f722 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.766566 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f6b65-98ee-4870-b9d3-fbd3c4e2f722 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.767349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f6b65-98ee-4870-b9d3-fbd3c4e2f722 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.768714 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 637/1270] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 19 00:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:36:12.773470 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cdbcb-b03d-4056-8d89-dcf990fe8c33 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.773808 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cdbcb-b03d-4056-8d89-dcf990fe8c33 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.774086 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cdbcb-b03d-4056-8d89-dcf990fe8c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.793913 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ba9cdbcb-b03d-4056-8d89-dcf990fe8c33 None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:12.795607 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ba9cdbcb-b03d-4056-8d89-dcf990fe8c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:12.804614 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 638/1271] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:36:12.817245 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cdbcb-b03d-4056-8d89-dcf990fe8c33 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:12.820262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474058e-4a4a-4b21-97b6-f503b6b68a53 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:12.826132 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c344e-909c-4037-9fc4-d1e77163a9e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:12.826773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c344e-909c-4037-9fc4-d1e77163a9e1 service placement] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.826899 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cdbcb-b03d-4056-8d89-dcf990fe8c33 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:12.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c344e-909c-4037-9fc4-d1e77163a9e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.827319 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c344e-909c-4037-9fc4-d1e77163a9e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e05c344e-909c-4037-9fc4-d1e77163a9e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:12.830525 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:12.831128 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:12.831404 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:12.831672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:12.840696 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c344e-909c-4037-9fc4-d1e77163a9e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:12.842125 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:12.842349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c344e-909c-4037-9fc4-d1e77163a9e1 service placement] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:12.843532 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:12.852507 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 634/1272] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:36:12.856119 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 639/1273] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:14.776138 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fd05-6063-44f9-a388-0a7d0b149292 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:14.776634 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fd05-6063-44f9-a388-0a7d0b149292 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:14.776976 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fd05-6063-44f9-a388-0a7d0b149292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:14.799178 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-3d07fd05-6063-44f9-a388-0a7d0b149292 None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:14.800388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-3d07fd05-6063-44f9-a388-0a7d0b149292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:14.807835 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 635/1274] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:36:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:36:14.820764 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:14.831757 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf7e31-74b7-407f-b714-e19776e85ad9 service neutron] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:14.836793 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:14.837410 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:14.837687 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:14.837958 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:14.846455 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:14.848007 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:14.856176 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 640/1275] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:36:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:36:24.793707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=70 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:24.853341 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=55 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:30.336963 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c2898-31bd-483a-9527-0404cd15c93e None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:30.337559 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c2898-31bd-483a-9527-0404cd15c93e None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:30.337559 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c2898-31bd-483a-9527-0404cd15c93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:30.356774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-2a2c2898-31bd-483a-9527-0404cd15c93e None None] MFA Rules not processed for user `eb62183c29e74f75a580306cf6cfae56`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:30.358645 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-2a2c2898-31bd-483a-9527-0404cd15c93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:30.365419 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 636/1276] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Oct 19 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:30.378806 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:30.387853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970644e-6584-412c-9bee-352bad3f373e service swift] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:30.391468 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560dff1-8d9c-4d2a-8cf3-f773340ffb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:30.392064 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560dff1-8d9c-4d2a-8cf3-f773340ffb29 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:30.392345 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560dff1-8d9c-4d2a-8cf3-f773340ffb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:30.392617 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560dff1-8d9c-4d2a-8cf3-f773340ffb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:30.399543 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560dff1-8d9c-4d2a-8cf3-f773340ffb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:30.400963 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560dff1-8d9c-4d2a-8cf3-f773340ffb29 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:30.409133 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 641/1277] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:31.229680 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa16ba8-b632-45ac-a447-8fee02eaa6bf None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:31.230015 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa16ba8-b632-45ac-a447-8fee02eaa6bf None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:31.230298 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa16ba8-b632-45ac-a447-8fee02eaa6bf None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:31.231679 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 637/1278] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:31.268671 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3279-0413-4b41-9266-11090f1e27bb None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:31.269004 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3279-0413-4b41-9266-11090f1e27bb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:31.269286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3279-0413-4b41-9266-11090f1e27bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:31.290660 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-969d3279-0413-4b41-9266-11090f1e27bb None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:31.291874 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-969d3279-0413-4b41-9266-11090f1e27bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:31.302293 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 642/1279] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:31.332243 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa16ba8-b632-45ac-a447-8fee02eaa6bf None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:31.349669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa16ba8-b632-45ac-a447-8fee02eaa6bf None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:31.356681 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def43e46-d86f-4d60-9716-01f3aeedb43d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:31.357980 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43e46-d86f-4d60-9716-01f3aeedb43d service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:31.358260 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43e46-d86f-4d60-9716-01f3aeedb43d service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:31.358532 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43e46-d86f-4d60-9716-01f3aeedb43d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:31.376861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def43e46-d86f-4d60-9716-01f3aeedb43d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:31.376861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def43e46-d86f-4d60-9716-01f3aeedb43d service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:31.384341 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 638/1280] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:39.283882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27830d7-ccb8-40c5-8ec4-643f83f4aa6a None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:39.284445 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27830d7-ccb8-40c5-8ec4-643f83f4aa6a None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:39.284445 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27830d7-ccb8-40c5-8ec4-643f83f4aa6a None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:39.285851 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 643/1281] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:36:39.298130 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eae67-5ec2-4174-89ca-0c6092a8fa9c None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:39.298669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eae67-5ec2-4174-89ca-0c6092a8fa9c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:39.298669 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eae67-5ec2-4174-89ca-0c6092a8fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:39.319571 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-861eae67-5ec2-4174-89ca-0c6092a8fa9c None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:39.320775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-861eae67-5ec2-4174-89ca-0c6092a8fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:39.330753 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:36:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:39.349750 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27830d7-ccb8-40c5-8ec4-643f83f4aa6a None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:39.364070 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27830d7-ccb8-40c5-8ec4-643f83f4aa6a None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:39.369436 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ce2cd-0368-4e11-9c69-3dd53f32a8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:39.370033 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce2cd-0368-4e11-9c69-3dd53f32a8e3 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:39.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce2cd-0368-4e11-9c69-3dd53f32a8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:39.370582 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce2cd-0368-4e11-9c69-3dd53f32a8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:39.379892 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ce2cd-0368-4e11-9c69-3dd53f32a8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:39.381490 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ce2cd-0368-4e11-9c69-3dd53f32a8e3 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:39.392198 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 644/1283] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:36:49.314748 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=12 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:49.387258 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=15 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:56.123352 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338a740-5537-466e-8aa6-8cd2e3cf267c None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:56.123816 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338a740-5537-466e-8aa6-8cd2e3cf267c None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:56.123894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338a740-5537-466e-8aa6-8cd2e3cf267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:56.143092 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-c338a740-5537-466e-8aa6-8cd2e3cf267c None None] MFA Rules not processed for user `0151a37ca51c41658110c29c3f73ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:56.144276 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-c338a740-5537-466e-8aa6-8cd2e3cf267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:56.151308 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 640/1284] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:36:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:56.464228 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783972eb-925f-44bd-b9ea-b8a1a3b694eb None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:56.464684 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783972eb-925f-44bd-b9ea-b8a1a3b694eb None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:56.464806 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783972eb-925f-44bd-b9ea-b8a1a3b694eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:56.484716 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-783972eb-925f-44bd-b9ea-b8a1a3b694eb None None] MFA Rules not processed for user `eb62183c29e74f75a580306cf6cfae56`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:36:56.486055 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-783972eb-925f-44bd-b9ea-b8a1a3b694eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:36:56.492419 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 645/1285] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:36:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:36:56.505584 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338a740-5537-466e-8aa6-8cd2e3cf267c None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:36:56.520136 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338a740-5537-466e-8aa6-8cd2e3cf267c None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:36:56.524378 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad46122-83a7-4df4-9a1c-afbd0ab942b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:36:56.524948 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46122-83a7-4df4-9a1c-afbd0ab942b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:36:56.525211 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46122-83a7-4df4-9a1c-afbd0ab942b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:36:56.525683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46122-83a7-4df4-9a1c-afbd0ab942b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:36:56.533841 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad46122-83a7-4df4-9a1c-afbd0ab942b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:36:56.535775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad46122-83a7-4df4-9a1c-afbd0ab942b4 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:36:56.546505 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 641/1286] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:36:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:04.341318 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783972eb-925f-44bd-b9ea-b8a1a3b694eb None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:04.350065 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783972eb-925f-44bd-b9ea-b8a1a3b694eb None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:04.353826 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e708ee8-6238-4498-91b1-88e99bfd2a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:04.354441 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e708ee8-6238-4498-91b1-88e99bfd2a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:04.354723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e708ee8-6238-4498-91b1-88e99bfd2a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:04.354991 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e708ee8-6238-4498-91b1-88e99bfd2a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:04.364015 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e708ee8-6238-4498-91b1-88e99bfd2a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:04.365520 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e708ee8-6238-4498-91b1-88e99bfd2a7f service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:04.375681 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 646/1287] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:06.338599 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c38bc-83e5-401a-8f26-4544e035ae46 None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:06.339179 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c38bc-83e5-401a-8f26-4544e035ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:06.339179 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c38bc-83e5-401a-8f26-4544e035ae46 None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:06.341367 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 642/1288] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 00:37:06.347868 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171eb07-1044-483e-b43e-51f0a4c3e435 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:06.348379 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171eb07-1044-483e-b43e-51f0a4c3e435 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:06.348480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171eb07-1044-483e-b43e-51f0a4c3e435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:06.373422 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-6171eb07-1044-483e-b43e-51f0a4c3e435 None None] MFA Rules not processed for user `a7e3cacb07c94c508868cff854dae659`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:06.374632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6171eb07-1044-483e-b43e-51f0a4c3e435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:06.394138 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 647/1289] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:37:06.407466 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c38bc-83e5-401a-8f26-4544e035ae46 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:37:06.423835 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c38bc-83e5-401a-8f26-4544e035ae46 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:37:06.431958 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1bad2-0275-44e7-8fb7-82dace281041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:37:06.433228 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1bad2-0275-44e7-8fb7-82dace281041 service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:06.434480 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1bad2-0275-44e7-8fb7-82dace281041 service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:06.434986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1bad2-0275-44e7-8fb7-82dace281041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:06.447196 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1bad2-0275-44e7-8fb7-82dace281041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:37:06.450233 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1bad2-0275-44e7-8fb7-82dace281041 service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:37:06.463649 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 643/1290] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:37:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:37:16.366882 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=12 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:16.458141 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=15 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:53.413712 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5057-8838-4b5e-b398-bd7cdfb80e15 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:37:53.414222 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5057-8838-4b5e-b398-bd7cdfb80e15 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:37:53.414331 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5057-8838-4b5e-b398-bd7cdfb80e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:37:53.434672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ebcc5057-8838-4b5e-b398-bd7cdfb80e15 None None] MFA Rules not processed for user `0151a37ca51c41658110c29c3f73ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:37:53.435888 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ebcc5057-8838-4b5e-b398-bd7cdfb80e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:37:53.442679 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 648/1291] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:03.429485 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:11.476736 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3560-ab33-4fb5-9a66-5102d275f2a0 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:11.477287 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3560-ab33-4fb5-9a66-5102d275f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:11.477373 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3560-ab33-4fb5-9a66-5102d275f2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:11.496322 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-930a3560-ab33-4fb5-9a66-5102d275f2a0 None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:11.497540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-930a3560-ab33-4fb5-9a66-5102d275f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:11.504658 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 644/1292] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:38:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:11.545812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5057-8838-4b5e-b398-bd7cdfb80e15 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:11.557267 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5057-8838-4b5e-b398-bd7cdfb80e15 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:11.565970 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b2ba5-eee6-4d1b-b214-b9fcd89e6621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:11.566581 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2ba5-eee6-4d1b-b214-b9fcd89e6621 service swift] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:11.566861 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2ba5-eee6-4d1b-b214-b9fcd89e6621 service swift] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:11.567129 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2ba5-eee6-4d1b-b214-b9fcd89e6621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:11.575763 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b2ba5-eee6-4d1b-b214-b9fcd89e6621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:11.577384 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b2ba5-eee6-4d1b-b214-b9fcd89e6621 service swift] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:11.585220 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 649/1293] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:38:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:38:16.964068 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f580d-aa26-4b3e-8fbc-9d6b5bf7b9f0 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:16.964588 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f580d-aa26-4b3e-8fbc-9d6b5bf7b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:16.964814 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f580d-aa26-4b3e-8fbc-9d6b5bf7b9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:16.983752 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-e99f580d-aa26-4b3e-8fbc-9d6b5bf7b9f0 None None] MFA Rules not processed for user `0151a37ca51c41658110c29c3f73ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:16.984983 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e99f580d-aa26-4b3e-8fbc-9d6b5bf7b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:16.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 645/1294] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:38:21.582039 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=6 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:26.978491 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=6 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:50.149856 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a396-4317-492b-acb1-edf213421700 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:50.150371 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a396-4317-492b-acb1-edf213421700 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:50.150545 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a396-4317-492b-acb1-edf213421700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:50.171038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-d8f1a396-4317-492b-acb1-edf213421700 None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:38:50.172237 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-d8f1a396-4317-492b-acb1-edf213421700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:38:50.179429 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 650/1295] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 00:38:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:38:50.193376 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f580d-aa26-4b3e-8fbc-9d6b5bf7b9f0 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:38:50.205881 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f580d-aa26-4b3e-8fbc-9d6b5bf7b9f0 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:38:50.210758 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e5bc-38d3-4e97-ad38-c1af7bcec232 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:38:50.211350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e5bc-38d3-4e97-ad38-c1af7bcec232 service swift] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:38:50.211626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e5bc-38d3-4e97-ad38-c1af7bcec232 service swift] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:38:50.211921 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e5bc-38d3-4e97-ad38-c1af7bcec232 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:38:50.220718 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160e5bc-38d3-4e97-ad38-c1af7bcec232 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:38:50.222366 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160e5bc-38d3-4e97-ad38-c1af7bcec232 service swift] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:38:50.230930 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 646/1296] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:38:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:39:00.165398 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:00.227281 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=6 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:13.136559 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f55ee-c1a5-4715-9fb5-ee7ed0a44981 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:13.137072 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f55ee-c1a5-4715-9fb5-ee7ed0a44981 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:13.137156 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f55ee-c1a5-4715-9fb5-ee7ed0a44981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:13.156748 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-ff7f55ee-c1a5-4715-9fb5-ee7ed0a44981 None None] MFA Rules not processed for user `0151a37ca51c41658110c29c3f73ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:13.158011 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ff7f55ee-c1a5-4715-9fb5-ee7ed0a44981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:13.164753 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 651/1297] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:39:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:14.364970 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ecce2-f6aa-47c0-9de8-f7745318736a None None] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:14.365448 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ecce2-f6aa-47c0-9de8-f7745318736a None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:14.365538 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ecce2-f6aa-47c0-9de8-f7745318736a None None] PATH_INFO: `/` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:14.366861 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 647/1298] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 00:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:39:14.371717 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e031f-cf0e-4955-9d35-1c7e7680e052 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:14.372105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e031f-cf0e-4955-9d35-1c7e7680e052 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:14.372311 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e031f-cf0e-4955-9d35-1c7e7680e052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:14.392238 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-4a3e031f-cf0e-4955-9d35-1c7e7680e052 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:39:14.393460 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4a3e031f-cf0e-4955-9d35-1c7e7680e052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:39:14.401877 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 652/1299] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:39:14.410026 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ecce2-f6aa-47c0-9de8-f7745318736a None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:14.424170 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ecce2-f6aa-47c0-9de8-f7745318736a None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:14.429128 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:14.429707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:14.429986 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:14.430258 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:14.438655 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:14.440201 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:14.449536 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 648/1300] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:24.387367 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=6 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:24.445684 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=6 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:30.707556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e031f-cf0e-4955-9d35-1c7e7680e052 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:39:30.717242 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e031f-cf0e-4955-9d35-1c7e7680e052 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:39:30.720736 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:39:30.721361 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:39:30.721655 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:39:30.721907 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:39:30.730727 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:39:30.732767 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:39:30.742738 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 653/1301] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:39:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:39:40.738197 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=6 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:26.094549 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.107339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55a54e-1999-4411-adf7-9c8cad17f11e service placement] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.112710 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.113343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.113626 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.113898 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.121393 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.122960 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.131737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 649/1302] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:26.180674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:26.189265 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5265984-82e0-451c-8ba3-67e79c24e56a service neutron] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:26.192731 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:26.193349 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:26.193627 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:26.193895 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:26.203474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:26.205481 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:26.215862 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 654/1303] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:32.142429 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:32.151468 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bd66d-adeb-4788-9dab-62927fd544fe service nova] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:32.155041 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075180-f14e-499e-98c5-8ebbf5d43423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:32.155630 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075180-f14e-499e-98c5-8ebbf5d43423 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:32.155906 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075180-f14e-499e-98c5-8ebbf5d43423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:32.156182 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075180-f14e-499e-98c5-8ebbf5d43423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:32.168298 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075180-f14e-499e-98c5-8ebbf5d43423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:32.169755 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075180-f14e-499e-98c5-8ebbf5d43423 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:32.180750 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 650/1304] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:33.334736 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:33.346728 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ca0d-a4a5-460e-b01c-341dec869e74 service neutron] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:33.352910 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:33.353605 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:33.353884 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:33.354154 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:33.363722 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:33.365324 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:33.376790 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 655/1305] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:34.513967 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743e1c-731f-4d41-ab63-6607d841b865 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:34.514418 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743e1c-731f-4d41-ab63-6607d841b865 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:34.514499 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743e1c-731f-4d41-ab63-6607d841b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:34.533183 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-e5743e1c-731f-4d41-ab63-6607d841b865 None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:34.534353 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-e5743e1c-731f-4d41-ab63-6607d841b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:34.541615 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 651/1306] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 00:41:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 00:41:34.587517 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:34.599052 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0a9a-150b-4a5a-9755-3c51f656ac0d service nova] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:34.604003 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:34.604599 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:34.604912 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:34.605191 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:34.613692 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:34.615256 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:34.622984 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 656/1307] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:35.101519 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a832-c901-428d-b21e-334d5420ff8f None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:35.101829 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a832-c901-428d-b21e-334d5420ff8f None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:35.102148 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a832-c901-428d-b21e-334d5420ff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:35.122563 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-8f84a832-c901-428d-b21e-334d5420ff8f None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:35.123746 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8f84a832-c901-428d-b21e-334d5420ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:35.131783 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 652/1308] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:41:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:35.145424 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:35.156203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b7e52-248c-4c84-81de-bd5db5e45171 service swift] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:35.162499 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:35.163105 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:35.163386 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:35.163661 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:35.172030 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:35.174122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:35.182477 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 657/1309] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:41:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:43.583002 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8c6ea-08b4-44c8-bd71-0183eb6ddbd9 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.583455 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8c6ea-08b4-44c8-bd71-0183eb6ddbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.583556 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8c6ea-08b4-44c8-bd71-0183eb6ddbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.602165 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-12f8c6ea-08b4-44c8-bd71-0183eb6ddbd9 None None] MFA Rules not processed for user `6908a293f30a4b229198d4990df9158c`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:43.603350 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-12f8c6ea-08b4-44c8-bd71-0183eb6ddbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:43.610612 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 653/1310] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:43.863950 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:43.873102 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036c28-fc42-43bd-8d71-c245646089d6 service swift] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:43.876867 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89106bc-dd96-45a4-8642-cacc7b039537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:43.877452 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89106bc-dd96-45a4-8642-cacc7b039537 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:43.877733 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89106bc-dd96-45a4-8642-cacc7b039537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:43.878007 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89106bc-dd96-45a4-8642-cacc7b039537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:43.884941 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89106bc-dd96-45a4-8642-cacc7b039537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:43.886339 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89106bc-dd96-45a4-8642-cacc7b039537 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:43.894471 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 658/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:44.207688 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8c6ea-08b4-44c8-bd71-0183eb6ddbd9 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:44.219918 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8c6ea-08b4-44c8-bd71-0183eb6ddbd9 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:44.226299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:44.226993 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:44.227281 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:44.227560 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:44.236895 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:44.238452 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:44.248351 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 654/1312] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:45.576172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0259a1-f429-4887-8da5-509594043913 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:45.576624 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0259a1-f429-4887-8da5-509594043913 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:45.576778 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0259a1-f429-4887-8da5-509594043913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:45.595674 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-4b0259a1-f429-4887-8da5-509594043913 None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:41:45.596919 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-4b0259a1-f429-4887-8da5-509594043913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:41:45.606796 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 659/1313] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 00:41:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:41:45.619758 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:45.632199 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83243f5-4426-41ee-a458-d7756e12488a service placement] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:45.638074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:45.638774 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:45.639167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:45.639865 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:45.649338 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:45.651108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:45.660339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 655/1314] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:41:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:47.138315 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0259a1-f429-4887-8da5-509594043913 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:47.152353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0259a1-f429-4887-8da5-509594043913 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:47.159549 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7b822-c836-469d-b202-efe1bfda5981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:47.160174 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b822-c836-469d-b202-efe1bfda5981 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:47.160450 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b822-c836-469d-b202-efe1bfda5981 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:47.160721 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b822-c836-469d-b202-efe1bfda5981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:47.169960 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7b822-c836-469d-b202-efe1bfda5981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:47.172177 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7b822-c836-469d-b202-efe1bfda5981 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:47.181888 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 660/1315] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:41:55.657326 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=33 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:57.177680 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=39 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:57.401883 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:41:57.411762 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817ae41-06d7-47af-8278-09b10039e710 service swift] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:41:57.416028 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:41:57.416707 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:41:57.417074 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:41:57.417540 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:41:57.425167 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:41:57.426593 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:41:57.434396 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 656/1316] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:41:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:02.631908 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1faeb-3fdc-4158-b3f9-2c4c2bc95f8f None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.632395 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1faeb-3fdc-4158-b3f9-2c4c2bc95f8f None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.632489 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1faeb-3fdc-4158-b3f9-2c4c2bc95f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.651620 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-f9e1faeb-3fdc-4158-b3f9-2c4c2bc95f8f None None] MFA Rules not processed for user `0151a37ca51c41658110c29c3f73ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:42:02.652853 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-f9e1faeb-3fdc-4158-b3f9-2c4c2bc95f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:42:02.659745 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 661/1317] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:42:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:42:02.970113 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:02.978415 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af24048-f70c-4a14-827d-00e44a96557b service neutron] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:02.982050 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:02.982646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:02.982928 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:02.983202 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:02.990798 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:02.992225 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:03.000056 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 657/1318] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:05.050594 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1faeb-3fdc-4158-b3f9-2c4c2bc95f8f None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:05.067264 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1faeb-3fdc-4158-b3f9-2c4c2bc95f8f None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:05.073085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:05.073803 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:05.074142 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:05.074495 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:05.085688 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:05.087261 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:05.099350 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 662/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:12.996588 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=12 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:15.094045 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=9 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:17.383113 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:17.391554 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5af7-e700-4ba0-86ea-059bac3f6560 service neutron] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:17.395775 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:17.396371 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:17.396650 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:17.397022 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:17.406457 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:17.408513 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:17.419391 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 658/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:19.024076 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:42:19.039960 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992971-8ec8-4496-ad1d-fa7be2fe39e9 service nova] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:42:19.047886 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0705d4-739c-403d-9655-1dd1024496ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:42:19.049417 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0705d4-739c-403d-9655-1dd1024496ba service nova] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:42:19.049723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0705d4-739c-403d-9655-1dd1024496ba service nova] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:42:19.050196 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0705d4-739c-403d-9655-1dd1024496ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:42:19.062038 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0705d4-739c-403d-9655-1dd1024496ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:42:19.063707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0705d4-739c-403d-9655-1dd1024496ba service nova] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:42:19.087493 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 663/1321] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:42:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:42:27.414800 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=6 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:29.071292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=6 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:15.053712 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:15.112370 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f065351-ed03-4fbd-b8e3-1819010971be service neutron] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:15.117582 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9904-6477-4fb4-b19d-c12a098b8cf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:15.118225 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9904-6477-4fb4-b19d-c12a098b8cf6 service placement] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:15.118508 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9904-6477-4fb4-b19d-c12a098b8cf6 service placement] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:15.118782 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9904-6477-4fb4-b19d-c12a098b8cf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:15.120646 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-d6bb9904-6477-4fb4-b19d-c12a098b8cf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:15.154683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9904-6477-4fb4-b19d-c12a098b8cf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:15.156262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9904-6477-4fb4-b19d-c12a098b8cf6 service placement] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:15.165998 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 659/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:25.161944 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=36 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:35.806427 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934d12-8397-48a1-b4bc-33c82028f192 None None] REQUEST_METHOD: `POST` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:35.806961 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934d12-8397-48a1-b4bc-33c82028f192 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:35.806961 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934d12-8397-48a1-b4bc-33c82028f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:35.827711 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.auth.core [None req-97934d12-8397-48a1-b4bc-33c82028f192 None None] MFA Rules not processed for user `0151a37ca51c41658110c29c3f73ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81478) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:35.828929 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-97934d12-8397-48a1-b4bc-33c82028f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:35.836299 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 664/1323] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:45.822695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=3 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:49.869799 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13ecb-2499-41cd-971e-e226d0caca55 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.870307 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13ecb-2499-41cd-971e-e226d0caca55 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.870388 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13ecb-2499-41cd-971e-e226d0caca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:49.904850 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-9ec13ecb-2499-41cd-971e-e226d0caca55 None None] MFA Rules not processed for user `688e9c5a658a4e32a4793d515ed11660`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:49.906060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-9ec13ecb-2499-41cd-971e-e226d0caca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:49.927991 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 660/1324] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:49.978270 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934d12-8397-48a1-b4bc-33c82028f192 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:49.990541 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934d12-8397-48a1-b4bc-33c82028f192 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:49.995842 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e51d2-2898-403c-b7eb-b310025ebc97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa883a98a0343d2be532c739910fb13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:49.996454 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e51d2-2898-403c-b7eb-b310025ebc97 service swift] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:49.996945 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e51d2-2898-403c-b7eb-b310025ebc97 service swift] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:49.997223 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e51d2-2898-403c-b7eb-b310025ebc97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.006710 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e51d2-2898-403c-b7eb-b310025ebc97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:50.008292 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e51d2-2898-403c-b7eb-b310025ebc97 service swift] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:50.016700 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 665/1325] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 00:44:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:50.392435 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec13ecb-2499-41cd-971e-e226d0caca55 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:50.411409 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec13ecb-2499-41cd-971e-e226d0caca55 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:50.415058 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0db837-f035-432a-b22f-198febc36607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:50.415652 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db837-f035-432a-b22f-198febc36607 service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:50.415932 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db837-f035-432a-b22f-198febc36607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:50.416206 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db837-f035-432a-b22f-198febc36607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:50.485737 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0db837-f035-432a-b22f-198febc36607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:50.487736 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0db837-f035-432a-b22f-198febc36607 service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:50.505715 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 661/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:53.970336 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87781899-ca16-4485-be06-f91c9111c146 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:53.970844 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87781899-ca16-4485-be06-f91c9111c146 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:53.970969 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87781899-ca16-4485-be06-f91c9111c146 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:53.972659 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 666/1327] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:54.185301 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.185829 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.185912 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.245741 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:54.246940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.256097 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 662/1328] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:54.267367 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87781899-ca16-4485-be06-f91c9111c146 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:54.270192 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-87781899-ca16-4485-be06-f91c9111c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:54.286474 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87781899-ca16-4485-be06-f91c9111c146 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:54.291572 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4daca-8fd5-4691-be54-666b4e88f1a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:54.292178 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4daca-8fd5-4691-be54-666b4e88f1a7 service placement] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:54.292480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4daca-8fd5-4691-be54-666b4e88f1a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:54.292742 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4daca-8fd5-4691-be54-666b4e88f1a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:54.303098 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4daca-8fd5-4691-be54-666b4e88f1a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:54.304669 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4daca-8fd5-4691-be54-666b4e88f1a7 service placement] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:54.314360 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 667/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:55.408291 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:55.410108 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:55.436652 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1e624-35cd-4992-a85a-d03ae6bac131 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:55.440974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8dbd0-a3c0-40ae-8608-987e6390196f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:55.441530 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8dbd0-a3c0-40ae-8608-987e6390196f service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:55.441802 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8dbd0-a3c0-40ae-8608-987e6390196f service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:55.442057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8dbd0-a3c0-40ae-8608-987e6390196f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:55.452664 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8dbd0-a3c0-40ae-8608-987e6390196f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:55.454235 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8dbd0-a3c0-40ae-8608-987e6390196f service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:55.467490 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 663/1330] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:58.229559 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259f5a-ea69-4334-afc4-c169276abd77 None None] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.230448 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259f5a-ea69-4334-afc4-c169276abd77 None None] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.230884 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259f5a-ea69-4334-afc4-c169276abd77 None None] PATH_INFO: `/` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.232307 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 668/1331] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 00:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 00:44:58.272267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e2bc-bb49-4257-bc54-b296574792f7 None None] REQUEST_METHOD: `POST` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.272818 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e2bc-bb49-4257-bc54-b296574792f7 None None] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.272818 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e2bc-bb49-4257-bc54-b296574792f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.293874 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.auth.core [None req-5915e2bc-bb49-4257-bc54-b296574792f7 None None] MFA Rules not processed for user `6812489400ac43578d5941fa839f71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81477) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 00:44:58.295095 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-5915e2bc-bb49-4257-bc54-b296574792f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:58.304461 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 664/1332] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 00:44:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 00:44:58.333061 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54259f5a-ea69-4334-afc4-c169276abd77 None None] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.348872 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54259f5a-ea69-4334-afc4-c169276abd77 None None] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:58.354054 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:58.354672 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.354952 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.355225 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.364531 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.366137 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:58.371250 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e2bc-bb49-4257-bc54-b296574792f7 None None] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.383400 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e2bc-bb49-4257-bc54-b296574792f7 None None] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:58.384812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 669/1333] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:44:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:58.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:58.392773 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.394242 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.394894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] PATH_INFO: `/v3/users/6908a293f30a4b229198d4990df9158c` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.396262 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6908a293f30a4b229198d4990df9158c)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.397531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: WARNING py.warnings [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:44:58.397531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: warnings.warn(msg) Oct 19 00:44:58.397531 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: Oct 19 00:44:58.399343 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:58.470821 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:58.483469 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6908a293f30a4b229198d4990df9158c'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.499512 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6908a293f30a4b229198d4990df9158c'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.500290 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6908a293f30a4b229198d4990df9158c'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.522882 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6908a293f30a4b229198d4990df9158c'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.533039 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6908a293f30a4b229198d4990df9158c'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.541864 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 665/1334] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:58 2022] DELETE /identity/v3/users/6908a293f30a4b229198d4990df9158c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:58.722183 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.732883 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010c9b-582b-4d00-95dc-2fb897855066 service placement] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:58.790155 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:58.790784 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.791064 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.791337 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] PATH_INFO: `/v3/projects/ac4a5a4ed48b4b77ba8a139620596b48` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.792424 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4a5a4ed48b4b77ba8a139620596b48)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.793462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: WARNING py.warnings [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 00:44:58.793462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: warnings.warn(msg) Oct 19 00:44:58.793462 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: Oct 19 00:44:58.794632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:58.848707 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4a5a4ed48b4b77ba8a139620596b48', 'request_id': 'req-5a228731-79ac-40c4-8972-bb9bf7db7b3e'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.854656 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4a5a4ed48b4b77ba8a139620596b48', 'request_id': 'req-5a228731-79ac-40c4-8972-bb9bf7db7b3e'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.863188 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4a5a4ed48b4b77ba8a139620596b48', 'request_id': 'req-5a228731-79ac-40c4-8972-bb9bf7db7b3e'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.894147 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] The token cache is being invalidate because project ac4a5a4ed48b4b77ba8a139620596b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:58.894440 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.895085 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:58.896590 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 670/1335] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:58 2022] DELETE /identity/v3/projects/ac4a5a4ed48b4b77ba8a139620596b48 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:58.900822 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:58.902331 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:58.916355 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de282778-8b99-41c3-9ae6-b3943f53e673 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:58.973053 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:58.973690 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:58.973974 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:58.974258 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] PATH_INFO: `/v3/users/5fb6606116514e509853c93957e8e2ee` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:58.975386 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb6606116514e509853c93957e8e2ee)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:58.977349 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:59.021498 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb6606116514e509853c93957e8e2ee'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.028267 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb6606116514e509853c93957e8e2ee'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.029057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb6606116514e509853c93957e8e2ee'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.041344 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb6606116514e509853c93957e8e2ee'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.048493 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb6606116514e509853c93957e8e2ee'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.054502 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 666/1336] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 00:44:58 2022] DELETE /identity/v3/users/5fb6606116514e509853c93957e8e2ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:44:59.228209 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:44:59.229723 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:44:59.244319 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a228731-79ac-40c4-8972-bb9bf7db7b3e admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:44:59.283308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:59.303286 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:44:59.303927 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:44:59.304297 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:44:59.304574 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] PATH_INFO: `/v3/projects/87794bd0bbc54a4d8bf7378605f19a9f` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:44:59.305898 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87794bd0bbc54a4d8bf7378605f19a9f)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:44:59.307912 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:44:59.353369 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87794bd0bbc54a4d8bf7378605f19a9f', 'request_id': 'req-1d1a3a8b-9028-4d43-8c3a-a323731e8277'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.358695 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87794bd0bbc54a4d8bf7378605f19a9f', 'request_id': 'req-1d1a3a8b-9028-4d43-8c3a-a323731e8277'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.366102 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87794bd0bbc54a4d8bf7378605f19a9f', 'request_id': 'req-1d1a3a8b-9028-4d43-8c3a-a323731e8277'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.377308 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] The token cache is being invalidate because project 87794bd0bbc54a4d8bf7378605f19a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81478) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:44:59.378202 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.378922 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:44:59.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 671/1337] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 00:44:59 2022] DELETE /identity/v3/projects/87794bd0bbc54a4d8bf7378605f19a9f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:45:09.051083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:09.374277 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:44.817902 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:44.820011 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:44.937207 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c1604-54f2-4fe9-9273-d0f476fed8fc admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:45.019339 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e3cacb07c94c508868cff854dae659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:45.019869 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:45.020151 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:45.020424 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:45.022315 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:45.024480 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:45.026496 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:45.036040 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:45.037683 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:45.049931 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 667/1338] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:45.099814 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3a8b-9028-4d43-8c3a-a323731e8277 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:45.103454 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:45.104073 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:45.104353 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:45.104632 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:45.106409 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:45.119981 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:45.121478 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:45.132390 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 672/1339] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 00:46:46.321299 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:46.330535 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6bbbf-ead6-4b9c-851c-b3b9026041ac service nova] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:46.334057 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:46.334642 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:46.334943 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:46.335209 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:46.337503 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:46.350083 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:46.351489 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:46.362553 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 668/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:46.815088 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:46.816498 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:46.828281 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beded944-cbc3-454f-8993-67879be4cc80 service neutron] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:46.831956 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:46.832556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:46.832863 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:46.833139 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:46.834820 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:46.917553 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:46.918986 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:46.943962 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 673/1341] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:56.358066 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=77 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:56.937407 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=67 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:57.202674 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:46:57.211034 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cb237-eb73-4e31-959c-bedcae877efa service neutron] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:46:57.214733 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb62183c29e74f75a580306cf6cfae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:46:57.215326 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:46:57.215627 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:46:57.215894 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:46:57.217623 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:46:57.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:46:57.281891 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:46:57.292096 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 669/1342] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:47:03.450497 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:03.452053 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:03.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5f0f9-38fc-45cb-aef1-78dbd1e3d1d5 service neutron] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:03.479203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:03.479203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:03.479203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:03.479203 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] PATH_INFO: `/v3/users/0151a37ca51c41658110c29c3f73ac69` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:03.479811 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0151a37ca51c41658110c29c3f73ac69)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:03.482625 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:03.531980 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0151a37ca51c41658110c29c3f73ac69'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.538809 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0151a37ca51c41658110c29c3f73ac69'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.552340 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0151a37ca51c41658110c29c3f73ac69'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.553044 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0151a37ca51c41658110c29c3f73ac69'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.560888 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0151a37ca51c41658110c29c3f73ac69'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.567122 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 674/1343] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:03 2022] DELETE /identity/v3/users/0151a37ca51c41658110c29c3f73ac69 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:03.738691 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:03.750913 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3c79-837e-4401-93c0-a30083a91d2f service neutron] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:03.807940 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:03.808490 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:03.808767 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:03.809067 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] PATH_INFO: `/v3/projects/9b82317133cc48ab839c482b143e1ac5` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:03.810160 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b82317133cc48ab839c482b143e1ac5)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:03.812064 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:03.858220 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b82317133cc48ab839c482b143e1ac5', 'request_id': 'req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.863643 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b82317133cc48ab839c482b143e1ac5', 'request_id': 'req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.871060 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b82317133cc48ab839c482b143e1ac5', 'request_id': 'req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.882109 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] The token cache is being invalidate because project 9b82317133cc48ab839c482b143e1ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81477) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:03.882395 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.883012 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:03.884545 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 670/1344] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:03 2022] DELETE /identity/v3/projects/9b82317133cc48ab839c482b143e1ac5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:03.888548 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:03.889971 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:03.903112 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68e42e-3f10-40a3-997a-6880aefccb4b admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:03.960233 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:03.960900 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:03.961187 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:03.961464 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] PATH_INFO: `/v3/users/2fb476f28ada4cba941995bcca3271a8` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:03.976136 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb476f28ada4cba941995bcca3271a8)` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:03.978591 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:04.024069 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb476f28ada4cba941995bcca3271a8'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.031557 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb476f28ada4cba941995bcca3271a8'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.037320 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:04.047791 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb476f28ada4cba941995bcca3271a8'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.048612 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb476f28ada4cba941995bcca3271a8'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.055850 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.notifications [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb476f28ada4cba941995bcca3271a8'} {{(pid=81478) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.062556 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 00:47:03 2022] DELETE /identity/v3/users/2fb476f28ada4cba941995bcca3271a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:04.237975 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Authenticating user token {{(pid=81477) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:47:04.239415 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.fernet_utils [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81477) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:47:04.252731 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a0988-6792-4b92-bb8d-9cc0d8b93ba6 admin admin] Validating token access rules against request {{(pid=81477) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:47:04.272784 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:04.311602 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0df48403b70414cb5833ddb3f121bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112d45203474f9493cb8a682f790adf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81477) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:47:04.312232 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:47:04.312508 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:47:04.312827 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] PATH_INFO: `/v3/projects/2cf2937999b844ed9d31209243ca1f6f` {{(pid=81477) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:47:04.323087 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf2937999b844ed9d31209243ca1f6f)` {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:47:04.325084 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] RBAC: Authorization granted {{(pid=81477) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:47:04.370398 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf2937999b844ed9d31209243ca1f6f', 'request_id': 'req-f603d994-46d8-4a1c-bf98-936c96250a31'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.375799 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf2937999b844ed9d31209243ca1f6f', 'request_id': 'req-f603d994-46d8-4a1c-bf98-936c96250a31'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.383227 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf2937999b844ed9d31209243ca1f6f', 'request_id': 'req-f603d994-46d8-4a1c-bf98-936c96250a31'} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.394547 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] The token cache is being invalidate because project 2cf2937999b844ed9d31209243ca1f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81477) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 00:47:04.394831 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.395443 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG keystone.notifications [None req-f603d994-46d8-4a1c-bf98-936c96250a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81477) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 00:47:04.396935 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: [pid: 81477|app: 0|req: 671/1346] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 00:47:04 2022] DELETE /identity/v3/projects/2cf2937999b844ed9d31209243ca1f6f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 00:47:14.059014 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:14.391706 dv-osbrick-master-4-iscsi devstack@keystone.service[81477]: DEBUG dbcounter [-] [81477] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:20.995475 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Authenticating user token {{(pid=81478) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 00:49:20.996931 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:21.184743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8208-430d-441e-b516-0201865ac710 admin admin] Validating token access rules against request {{(pid=81478) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 00:49:21.245743 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6df15e-825e-4bc0-8df1-00b51d353f4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6812489400ac43578d5941fa839f71c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7faa7d4815647198a759f065527af0c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81478) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 00:49:21.246350 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6df15e-825e-4bc0-8df1-00b51d353f4e service placement] REQUEST_METHOD: `GET` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 00:49:21.246631 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6df15e-825e-4bc0-8df1-00b51d353f4e service placement] SCRIPT_NAME: `/identity` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 00:49:21.246903 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6df15e-825e-4bc0-8df1-00b51d353f4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81478) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 00:49:21.248640 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.fernet_utils [None req-6b6df15e-825e-4bc0-8df1-00b51d353f4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81478) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 00:49:21.259585 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6df15e-825e-4bc0-8df1-00b51d353f4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 00:49:21.261172 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6df15e-825e-4bc0-8df1-00b51d353f4e service placement] RBAC: Authorization granted {{(pid=81478) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 00:49:21.270759 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: [pid: 81478|app: 0|req: 676/1347] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 00:49:31.266812 dv-osbrick-master-4-iscsi devstack@keystone.service[81478]: DEBUG dbcounter [-] [81478] Writing DB stats keystone:SELECT=58 {{(pid=81478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}